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PREFACE 


For  the  tenth  year,  the  Research  and  Theory  Division  of  the  Association  for  Educational 
Communications  and  Technology  (AECT)  is  publishing  these  Proceedings.  Papers  published  in 
this  volume  were  presented  at  the  national  AECT  Convention  in  New  Orleans,  LA.  A  limited 
quantity  of  this  volume  were  piinted  and  sold.  It  is  also  available  on  microfiche  through  the 
Educational  Resources  Information  Clearinghouse  (ERIC)  system. 

REFEREEING  PROCESS:  All  research  papers  selected  for  presentation  at  the  AECT  Convention 
and  included  in  this  Proceedings  were  subjected  to  a  rigorous  blind  reviewing  process. 
Proposals  were  submitted  to  Dr.  John  Wedman  of  the  University  of  Missouri,  who 
coordinated  the  review  process.  All  references  to  author  were  removed  from  proposals 
before  they  were  submitted  to  referees  for  review.  Approximately  fifily  percent  of  the 
manu^ripts  submitted  for  consideration  were  selected  for  presentation  at  the  Convention 
and  for  Publication  in  these  Proceedings.  The  papers  contained  in  this  document  represent 
some  of  the  most  current  thinking  in  educational  communications  and  technology. 

This  volume  contains  two  cumulative  indexes  covering  the  most  recent  four  volumes, 
1985  - 1988.  The  first  is  an  author  index.  The  second  is  a  descriptor  index.  The  two  indexes 
will  be  updated  in  future  editions  of  this  Proceedings.  The  index  for  volumes  1-6  (1979-84) 
are  included  in  the  1986  Proceedings. 
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Editor 
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ABSTRACT 


The  purpose  of  the  stuc^  was  to  investigate  the  effects  of 
solution  oriented  and  strategy  oriented  feedback*  The  feedback 
confirmed  problem  solving  strategies  that  were  either  similar 
to  the  learner's  cognitive  strategies  i.e. 9  spatial  strategies, 
or  different  from  the  learner ^s  cognitive  strategies  i.e.  9 
perceptual  strategies.  The  dependent  variables  were:  1}  the 
number  of  problems  the  learner  solved  correctly  within  a 
limited  time,  and  2}  the  number  of  learners  who  shifted  to 
better  choices  on  a  questionnaire  designed  to  measure  their 
cognitive  strategies.  The  subjects  were  65  undergraduate 
students.  Four  computer  programs  were  designed  to  instruct  the 
subjects  on  spatial  or  perceptual  strategies  to  solve 
three-term  series  problems,  using  strategy  or  solution 
feedback.  The  method  of  instruction  was  guided  discovery. 
Significant  interaction  was  found.  The  results  partly  supported 
a  theoretical  framework.  Several  questions  were  raised  for  - 
future  research. 
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The  Effect  of  Computer  Based  Feedback 
on  Using  Cognitive  Strategies  of  Problem  P.^ving 


In  interactive  computer  assisted  instruction,  feedback  nay 
assist  the  learner  to  discover  effective  cognitive  strategies 
of  problem  solving.  Computer  based  feedback  may  present  only 
the  amount  and  type  of  information  that  assists  the  learner  in 
identifying  the  relevant  cues  and  relationships  in  a  problem, 
and  in  selecting  effective  procedural  rules  for  solving  the 
problem.  It  may  also  enhance  the  development  and  use  of 
cognitive  skills  that  guide  the  learner  in  selecting  and 
organizing  effective  rules  to  regulate  and  monitor  deductions 
made  toward  the  solution  of  the  problem  (Gagne,  1985;  Gagne  & 
Briggs,  1979;  Gallini,  1985;  Kozma,  1936;  Tennyson,  1986). 

Kevertheless,  the  effect  of  computer  based  feedback  on  the 
learner's  development  and  use  of  effective  cognitive  strategies 
of  problem  solving  has  not  been  directly  explored.  Exploring 
this  effect  could  guide  the  design  and  development  of  effective 
instruction  in  proULem  solving.  It  could,  moreover,  e^qplain  the 
contradictory  results  of  the  effect  of  feedback  on  learning. 

Rigney  (1978)  identified  four  basic  categories  of 
techniques  in  automated  instructional  systems  that  may  enhance 
the  development  and  organization  of  the  learner's  costive 
processes.  They  are:  1;  orienting  tasks  or  directions  that 
induce  the  learner,  either  directly  or  indirectly,  to  perform 
specific  operations,  2)  content  bridges  or  material  that  is 
specific  to  a  particular  subject  matter,  3)  cognitive 
strategies  that  facilitate  the  acquisition,  retention,  and 
retrieval  of  subject  matter,  and  that  are  initiated  by  the 
learner  or  the  instructional  system,  and  4)  knowledge  of 
results.  Rigney,  however,  did  not  specify  how  knowledge  of 
results  acts      itself,  or  how  it  interacts  with  the  other 
elements  in  the  system,  to  facilitate  learning. 

On  the  other  hand,  Kulhavy  (1977)  reviewed  the  literature 
on  feedback  used  in  written  instructional  material  searching 
for  an  e^qplanation  of  the  contradictory  findings  of  feedback 
research.  He  concluded  that  feedback  following  a  correct 
response  would  be  effective  as  it  confirms  the  learner's 
"comprehension  strategies^  i.e.,  it  informs  the  learner  that 
his/her  strategies  helped  achieve  the  goal.  Feedback  will  be 
even  more  effective  after  an  incorrect  response  as  it  allows 
the  learner  to  identify  the  error,  and  under  appropriate 
conditions,  correct  that  error. 

Research  evidence  suggested  to  Kulhavy  that  feedback  is 
ineffective  in  two  instances.  The  first  is  \ihen  the  learner  is 
unable  to  comprehend  the  instruction  and  fit  it  in  an  existing 
cognitive  framework.  In  this  instance  the  learner  keeps 
guessing  at  the  answer  and  tiding  to  arbitrarily  associate  a 
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response  with  a  correct  answer.  The  second  instance  is  when  the 
feedback  is  available  to  the  learner  before  he/she  responds,  an 
Instance  that  is  avoidable  in  conputer  assisted  instruction. 

In  line  with  the  conclusions  Kulhavy  drew  from  the 
feedback  research,  Rmaelhart  &  Norman  (1978)  stated  that 
feedback  na/  affect  the  learner's  cognitive  operations  in  one 
of  three  ways.  It  may:  (1)  confirm  a  correct  answer  and  thus 
lead  to  the  addition  of  new  information  to  existing  schemata 
and  strategies,  (2)  time  the  existing  schemata  and  strategies 
by  pointing  to  minor  errors  that  need  correction,  or  (3)  point 
to  major  errors  in  the  learner's  schemata  and  strategies,  and 
guide  the  learner  in  restructuring  them,  iMch  is  a  difficult 
and  time  consuming  task. 

The  above  theory  works  on  the  assumption  that  feedback 
confirms  definite  cognitive  frameworks  and  strategies.  Ifowever, 
in  computer  assisted  problem  solving  there  are  cases  ^en 
feedback  is  designed  to  confirm  correct  solutions  to  problems 
regfurdless  of  the  cognitive  strategies  the  learner  follows  to 
arrive  to  the  solutions.  The  learaer  coiald  arrive  to  the  same 
solutions  using  different  cognitive  strategies,  or  no  clear 
strategies. 

Consequently,  feedback  in  problem  solving  instruction  may 
be:  1 )  solution  oriented,  as  when  it  informs  the  learner 
wiether  the  product  of  a  mathematical  problem— for  example— is 
correct  or  incorrect  regardless  of  the  procedures  and  cognitive 
strategies  used  to  arrive  to  the  product,  and  2)  strategy 
oriented,  as  ^en  it  informs  the  learner  Aether  the  cues  and 
relationsh-^.ps  he/she  identifies  in  a  problem  are  relevant  and 
correct,  v^ether  the  rules  he/she  follows  are  appropriate,  and 
i^ether  his/her  way  of  organizing  and  applying  the  rules  is 
efficient. 

Moreover,  the  effect  of  feedback  may  interact  with  the 
cognitive  strategies  the  learner  develops  before  the 
instruction.  In  other  words,  the  effect  of  feedback  does  not 
only  depend  on  \diether  the  feedback  is  strategy  oriented  or 
solution  oriented,  but  also  on  Aether  the  learner  is  using 
certain  cognitive  strategies  in  the  first  place.  Consequently, 
solution  feedback  may  unintendedly  and  indirectly  confirm  or 
not  confirm  the  cognitive  strategies  the  learner  is  using. 
Figure.  1  represents  the  predicted  interaction  between  feedback 
and  the  learner  cognitive  strategies. 


BSERT  FIGURE  1  ABOUT  HflRE 


Figure  1  shows  that  feedback  may  increase,  decrease,  or 
not  affect  performance  in  a  problem  solving  situation.  The 
effect  of  feedback  depends  on:  1 }  the  function  of  feedback 
(strategy  oriented      solution  oriented),  and  2}  vhether  the 
feedback  confirms  oz^flot  conf irm^^  the  cognitive  strategies  the 
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learner  is  using. 

Evidence  from  research  suggests  an  interactive  effect 
between  feedback  and  the  learner's  possible  iise  of  cognitive 
strategies.  Boysen,  1980;  Isliam,  1980;  and  Renzi,  197^  found 
that  field-dependent  siibjects  benefited  ftom  explanation 
feedback  more  than  field-^independent  subjects.  Since 
field-dependent  subjects  are  inclined  to  respond  to  the 
environment  in  a  global  rather  than  an  analytical  vay^  they  may 
also  be  less  inclined  to  develop  and  use  cognitive  strategies 
in, problematic  situations.  FieldniepOTdent  subjects  are 
therefore  e:q)ected  to  benefit  more  from  feedback  as  it  helps 
them  identify  relevant  features  and  relationships  in  a  problem, 
and  helps  them  select  or  develop  appropriate  procedures  and 
cognitive  strategies. 

Contrary  to  the  above  findings,  Boysen  &  Thomas  (1980) 
found  that  field-dependent  subjects  benefited  more  from 
"implicit  feedback"  while  field-independent  subjects  benefited 
more  from  "explicit  feedback".  The  subjects •  task  was  to 
practice  solving  linear  equations.  Impilicit  feedback  showed 
subjects  how  to  perform  operations  they  i^uested  regardless  of 
\diether  these  operations  were  relevant  or  irrelevant  to  the 
problem  at  hand.  Explicit  feedback  showed  subjects  how  to 
perform  the  operations  they  requested  only  when  the  operations 
were  relevant  to  the  problem.  If  the  operations  i^uested  were 
irrelevant,  the  subjects  were  shown  the  relevant  operations. 

As  the  e^rimenters  noted,  a  field-dependent  subject 
could  have  benefited  from  the  analytical  operations  provided 
tiie  impilicit  feedback.  On  the  other  hand,  field  -independent 
subjects  could  have  been  testing  strategies  through  explicit 
feedback.  Had  explicit  feedback  been  given  to  field-  deperident 
subjects  through  force  order  instruction,  they  probably  would 
have  performed  better  receiving  explicit  rather  tlian  liplicit 
feedlack. 

Cognitive  strategies  could  be  an  intermediate  variable 
responsible  for  the  unexpected  results  of  feedback  found  by 
Spock  (1987).  The  performance  of  undergraduate  students 
instructed  in  BASIC  did  not  vary  \ihen  they  received  explanatory 
feedback  from  the  perf oj^mance  of  others  who  received  knowledge 
of  results  feedback.  However,  the  results  did  indicate  that 
subjects  with  prior  knowledge  benefited  more  from  explanatory 
feedback.  Since  prior  knowledge  is  an  indicator  of  the 
availability  of  cognitive  framev:orks  and  strategies  (Larkin, 
McDermott,  Simon,  &  Simon,  1980),  those  subjects  may  have  been 
able  to  improve  their  frameworks  and/or  strategies  as  they 
received  e^lanatory  feedback. 

Johnson  &  Plake  (1977)  found  that  graduate  students 
performed  better  when  they  received  feedback  after  each  step 
they  made  in  the  analysis  of  variance.  Similarly,  Roper  (1977) 
found  that  the  performance  of  undergraduate  students  in 
statistics  was  superior  when  they  received  feedback  that  stated 
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the  correct  answer  compared  to  their  performance  idien  they 
received  feedback  that  simply  indicated  whether  their  response 
was  correct  or  incorrect. 

The  purpose  of  the  present  study  was  to  investigate  the 
effect  of  strategy  feedback  and  solution  feedback  on  developing 
and  using  cognitive  strategies  of  problem  solving.  The  effect 
of  this  variable  was  studied  as  it  interacted  \dth  the 
learner's  cognitive  strategies. 

Strategy  feedback  was  given  to  the  subjects  througihout 
instruction  on  problem  solving.  The  feedback  informed  them 
whether  tlieir  responses  to  the  features  of  a  problem,  the 
relationships  between  the  features,  and  the  procedures  they 
followed  to  solve  the  problem  were  correct  or  incorrect.  Ihe 
feedback  also  indicated  v^t  the  correct  responses  were,  and 
why.  Solution  feedback  was  given  to  tlie  subjects  only  as  they 
solved  practice  problems  to  inform  them  \diether  a  solution  to  a 
problem  was  correct  or  incorrect,  and  what  the  correct  solution 
was. 

Strategy  feedback  and  solution  feedback  either  confirmed  or 
did  not  confirm  the  subject's  cognitive  strate^es.  This  was 
done  by  measuring  the  cognitive  strategies  the  subjects  used  to  " 
solve  problems  prior  to  the  instruction,  then  instructing  them 
on  strategies  that  were  either  similar  to,  or  different  from 
the  cognitive  strategies  they  used. 

Two  dependent  variables  were  used.  They  were:  J)  the 
niunber  of  problems  solved  correctly  within  a  limited*  time  on  a 
posttest,  and  2)  the  munber  of  the  subjects  who  shifted  to  a 
better  choice  on  a  questionnaire  designed  to  measure  the 
strategies  they  used  to  solve  pretest  and  posttest  problems. 

The  following  hypotheses  were  tested: 

1.  The  performance  of  the  subjects  who  receive  strategy 
feedback  that  confirms  their  strate^es  will  be  superior  to  the 
performance  of  the  subjects  who  receive  solution  feedback  that 
indirectly  confirms  their  strategies. 

2.  The  perfonnance  of  the  subjects  who  receive  strategy 
feedback  that  confirms  their  strategies  will  be  superior  to  the 
performance  of  the  subjects  who  receive  strategy  feedback  that 
does  not  confirm  their  strategies. 

3«  The  performance  of  the  subjects  who  receive  solution 
feedback  will  be  superior  to  the  perfoarmance  of  the  subjects 
who  receive  strategy  feedback  that  does  not  confirm  their 
strategies. 

The  performance  of  the  subjects  who  receive  solution 
feedback  that  indirectly  confirms  their  strategies  will  be 
superior  to  the  performance  of  the  subjects  who  receive 
solution  feedback  that  does  not  confirm  their  strategies. 
5»  More  subjects  will  modify  their  cognitive  strategies  vdien 
thoy  receive  strategy  feedback  than  \Aien  they  receive  solution 
feedback. 
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METHOD 

SuMects: 

Ttie  subjects  were  65  volunteer  udergraduate  students i 
males  and  females ,  enrolled  in  three  sections  of  a  coniputer 
literacy  class  at  the  University  of  Texas  at  Austin.  The 
subjects  were  assigned  randomly  to  four  groips,  corresponding 
to  the  four  cells  of  a  2*2  factorial  design. 

Pilot  Study: 

A  pilot  study  was  conducted  on  32  students  drawn  from  a 
fourth  section  of  the  same  computer  literacy  class.  The  main 
purpose  of  the  pilot  study  was  to  determine  idiether  the 
students  used  cognitive  strategies  to  solve  the  type  of 
.problems  used  in  the  study,  and  if  they  did,  yhaX  kind  of 
strategies.  The  materials  and  measurments  developed  for  the 
main  study  were  used  in  the  pilot  study.  The  results  of  the 
pilot  study  indicated  that  30  out  of  the  32  students  used 
spatial  cognitive  strategies  to  solve  the  problems.  A  ceiling 
effect  was  also  detected.  Appropriate  changes  were  thus  made  in 
the  materials  and  procedures. 


TTir:tT^ifftionfll  nnntfintg  Instructional  content  was  selected  to  be 
generic  roblem  solving.  Three-term  series  problems  were  used. 
An  exair  .e  of  the  probleras  is: 

f  .  :.siy  is  taller  than  Wanda. 
DA  is  taller  than  Albert. 

V/ho  is  the  tallest? 

There  are  8  different  determinate  structures  to  this 
problem.  For  Gach  of  these  structures,  two  problems  may  be 
formulated:  (1)  one  problem  when  the  final  question  asks  for 
the  largest  term,  and  (2)  the  second  problem  \^en  the  final 
question  asks  for  the  smallest  tera.  Consequently,  a  total  of 
16  problems  could  be  constructed  using  liie  same  terms  and 
comparatives.  Countless  problems,  however,  could  be  constructed 
using  different  terms  and  comparatives. 

In  the  present  study,  the  names  of  males  and  females  were 
used  as  terms.  Different  verbs  and  comparatives  were  also  used 
to  avoid  the  repetition  of  the  problems,  and  to  relate  them  to 
events  familiar  to  the  subjects. 

Since  thi*ee-"term  series  problems  are  logical  problems, 
valid  inferences  are  drawn  from  their  premises.  A  rule  of 
inference  is  essentially  syntactic  in  nature  i.e.,  it  dictates 
\^t  can  be  drawn  from  e^qpressions  on  the  bases  or  their  forms 
regardless  of  their  meaning  (Johnson  --Laird,  1985).  £>ddence 
from  research  indicates  that  college  students  solved  three^term 
series  problems  using  spatial  cognitive  strategies  (De  Soto, 
London,  and  Handle,  1965;  Huttenlocher,  1968).  In  addition. 
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some  students  discovered  the  perceptual  features  of  the  problem 
and  developed  perceptual  strategies  to  solve  them* 
(Johnson-Laird  &  Bara,  1934?  Quinton  &  Follows,  1975).  The 
perceptual  strategies  enabled  the  subjects  to  solve  the 
problems  without  forming  the  seriesi  and  with  a  minimal  load  to 
the  working  memory*  As  a  result,  the  subjects  who  used 
parcptiaal  strategies  took  significantly  less  time  to  solve  the 
prolslems  than  those  yho  used  spatial  strategies* 

In  the  present  stud/y  four  computer  programs  were 
developed*  The  four  programs  gave  identical  instruction  on  the 
f  eatux'es  of  the  problems  and  the  relationships  between  the 
featux'es*  Two  out  of  the  four  programs  gave  instruction  on 
spatial  strategies  to  solve  the  problems,  vMle  the  other  two 
programs  gave  instruction  on  perceptual  strategies  to  solve  the 
same  problems*  The  instruction  on  the  strategies  was  followed 
with  identical  practice  problems* 

The  method  of  instruction  in  the  four  programs  was  the 
guided  discovery  method,  as  outlined  by  Collins  (1985)*  Forty 
two  questions  were  posed  systematically  in  eadi  program  to 
guide  the  learner  to  relevant  aspects  of  the  proU.em,  and  to 
the  thinking  skills  needed  to  solve  the  problems  when  following 
either  spatial  or  perceptual  strategies* 

(he  spatial  strategies  program  and  one  perceptual 
strategies  program  gave  strategy  oriented  feedback,  while  the 
other  two  programs  gave  solution  oriented  feedback*  The 
strategy  feedback  indicated  to  the  subjects,  after  each 
response  to  the  forty  two  questions  in  the  program,  whether  the 
response  was  correct  or  incorrect*  If  the  response  was  correct 
the  subjects  were  still  informed  of  the  correct  answer,  and  of 
i4]y  the  answer  was  considered  correct*  If  the  response  was 
incorrect,  'the  cues  relevant  to  the  answer  were  higihighted  for 
the  subjects  and  they  were  asked  to  try  again*  The  subjects 
were  informed  after  the  second  tzy  if  the  response  was  correct 
or  incorrect,  informed  of  Uie  correct  answer,  and  of  yby  the 
answer  was  considered  correct* 

The  solution  feedback  was  given  to  the  subjects  after 
solving  the  practice  problems  only*  The  subjects  were  informed 
whether  their  solution  was  correct  or  incorrect  and  were  asked 
to  try  again*  The  subjects  were  then  informed  whether  their 
secoiKl  try  was  correct  or  incorrect,  and  of  the 
correct  solution* 

Ifeasurment  Of  Problem  Solving:  Sixty  four  three<-term  series 
problems  were  designed  after  the  16  possible  determinant 
problem  structures,  four  for  each  structure*  Thirty  two  of 
these  problems  were  used  as  a  pretest  and  the  other  32  as  a 
posttest*  The  pretest  and  the  posttest  problems  were  matched* 
Measurement  Of  Cognitive  Strategies:  A  questionnaire  was 
developed  to  measure  the  cognitive  strategies  the  subjects  used 
to  solve  both  the  pretest  and  the  posttest  problems*  The 
questionnaire  consisted  of  20  multiple  choice  items  and  one 
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short  answer  item*  Eight  of  the  multiple  choice  items  were 
about  the  features  of  the  probleas  and  the  relationships 
between  the  features  •  Six  items  were  about  the  spatial 
strategies,  and  the  remaining  6  items  wei*s  about  the  perceptual 
Btrategies*  There  was  a  better  answer  to  each  item*  The  better 
answer  reflected  the  most  efficient  way  to  solve  the  problems* 
Tae  short  answer  item  asked  the  subjects  to  list  inental  tricks, 
strategies,  rules,  or  steps  they  followed  in  their  mind  as  they 
solved  the  problems. 

Proceduyeg 

The  experiment  was  conducted  in  two  sesBions*  During  the 
first  session,  each  subject  in  a  section  of  the  computer 
literacy  class  was  instructed  to  solve  the  32  problems  of  the 
pretest  as  quickly  and  acciirately  as  possible,  without  using 
aqy  materials  such  as  paper  and  pencil,  and  without  using 
his/her  hands  or  fingers  to  figure  the  solution*  The 
instructions  informed  the  subject  that  he/she  would  have  7 
minutes  to  solve  the  problems,  and  that  the  computer  woizld  stop 
presenting  the  items  when  the  time  was  up* 

At  the  end  of  the  test,  the  subjects  were  shown  the 
number  of  correct  responses,  and  were  asked  to  answer  the 
questionnaire*  The  computer  recorded  the  subjects'  correct 
responses  on  the  pretest* 

During  the  second  session,  a  week  later,  the  subjects 
follc-/ed  similar  procedures,  only  this  time  they  went  throiigh 
one  of  the  foiar  instructional  programs  before  the  posttest*  In 
addition,  the  programs  cued  the  subjects  to  enter  the  time  they 
st-arted  the  instruction  and  the  time  they  finished  it*The 
computer  recorded  the  subjects'  correct  responses  during  the 
instruction  and  during  the  posttest* 

The  tests  and  instruction  were  administered  via  an  Apple 
11S  computer*  They  were  written  using  Super  Pilot* 

Design: 

A  2  ^  2  between  subjects  factorial  design  was  employed, 
the  factors  being:  1)  feedback,  strategy  oriented  or  soluticn 
oriented;  and  2)  the  cognitive  strategies  the  feedback 
confirmed,  spatial  strategies  or  perceptual  strategies*  The 
spatial  strategies  were  similar  to  the  subjects'  cognitive 
strategies,  while  the  perceptual  strategies  were  different  fton 
the  subjects  cognitive  strategies* 
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REsui/rs 


Table  1  shows  the  means  and  standard  deviations  of  the  /^ 
treatment  groups  for  the  pretest  and  the  posttest  scores,  the 
time  spent  in  receiving  the  instruction  (in  minutes),  and  the 
number  of  correct  responses  durizig  the  instruction. 


EJSiKT  TABLE  1  ABOUT  HERE 


The  means  were  higher  in  the  posttest  than  the  pretest, 
whi3.e  the  standard  deviations  were  lower.  The  r'Hiian  of  the 
entire  sample  on  the  pretest  was  29.00  out  of  a  possible  score 
of  32,  and  the  range  was  19.  The  median  was  raised  to  a  score 
of  31  in  the  posttest,  with  a  range  of  U. 

Pearson  correlation  coefficients  were  calculated  between 
pretest  scores,  posttest  scores,  treatment  duration,  and  number 
of  correct  respcaases  during  the  treatment.  Significant  positive 
correlations  were  found  between  posttest  scores  and  pretest 
scores  (coefficient  «  .52,  n  «  65,  ^=  .000),  and  between 
posttest  scores  and  number  of  correct  responses  during 
treatment  (coefficient  «  .30,  n'^*  64,  wC.01).  A  significant 
positive  correlation  was  also  found  between  treatment  duration 
and  number  of  correct  responses  during  treatment,  (coefficient 
=  .^0,  n  =  57,i  «  .001). 

Spearman-Brown  test  of  reliability  was  conducted  on  the  6 
items  of  the  questionnaire  that  measured  Ss  cognitive  spatial 
strategies,  and  on  the  6  items  that  measured  their  cognitive 
perceptual  strategies  using  the  split  half  method.  The 
reliability,  coefficients  were  .89  and  .66,  respectively. 

Prior  to  performing  AlICOVA,  the  assumption  of  homogeniety 
of  regression  was  tested  for  the  posttest  as  a  dependent 
variable  and  the  pretest  as  a  covariate.  The  test  was 
nonsignificant  (£>.32),  indicating  that  homogeniety  of 
regression  was  tenable.  Table  2  reports  the  results  of  AIJGOVA. 


lifSERT  TABLE  2  ABOUT  HJM 


Table  2  shows  that  the  main  effects  of  both  factors  were 
nonsignificant.  However,  there  was  a  significant  feedback  by 
strategy  interaction  £(1,60)  «  4.22,  £  «  .04.  The  interaction 
is  illustrated  in  Figure  2. 
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HSI51T  jpIGUHE  2  ABOUT  HFiE 


Figure  2  shovs  that  strategy  feedback  was  more  effective 
lAen  it  confirmed  strategies  that  were  similar  to  the  subjects' 
cognitive  strategies  i.e.,  spatial  strategies,  than  vhea  it 
confirmed  strategies  that  were  different  from  the  subjects' 
cognitive  strategies  i.e.,  perceptual  strategies.  The  adjusted 
means  were  30.52  and  28.59i  respectively.  Conversely,  solution 
feedback  was  more  effective  when  it  confirmed  the  perceptual 
strategies  (adjusted  mean  «  30.16)  rather  than  the  spatial 
strategies  (adjusted  mean  «  29.37). 

(M  squares  were  conducted  on  each  item  of  the 
questionnaire  to  find  out  the  effect  of  the  four  treatments  on 
the  number  of  subjects  v^o  shifted  to  a  better  choice. 
Significant  differences  were  found  with  respect  to  A  itens 
only.  Chi  squares  were  then  conducted  to  Investigate  the  effect 
of  strategy  feedback  versus  solution  feedback  on  the  number  of 
subjects  who  indicated  that  they  changed  the  strategies  they 
used  after  the  instruction  from  those  they  used  prior  to  the 
instruction.  The  Chi  square  was  significant  (Chi  square  «  3.90, 
df  «  1,  £  =  .05) 


DISCUSSION 

The  purpose  of  the  study  was  to  examine  the  effects  of 
solution  oriented  and  strategy  oriented  feedback.  The  feedback 
confirmed  problem  solving  strategies  that  were  either  similar 
to  the  learner's  cognitive  strategies  (spatial  strategies),  or 
different  from  the  learner's  cognitive  strategies  (perceptual 
strategies)*  The  dependent  variables  were:  1)  the  number  of 
problems  the  learners  solved  correctly  within  a  limited  time, 
and  2)  the  number  of  learners  who  shifted  to  better  choices  on 
a  questionnaire  designed  to  measure  their  cognitive  strategies. 

Vfiien  the  learners  were  instructed  on  the  spatial 
strategies,  strategy  feedback  was  more  effective  than  solution 
feedback.  The  results  suggest  that  feedback  given  throughout 
the  instructon  on  problem  solving  .modifiwJhej^eamsr  '^ 
cognitive  strategies  only  if  Hiep^  'stratdgiSs^aflS  dliMlar--tc 
some  extent~->to  the  learner's  cognitive  strategies.  These 
results  support  the  notion  of  a  corrective  (Kulhavy,  1977),  or 
tuning  (Runelhart  &  Horman,  1978)  effect  of  feedback  on 
cognitive  frameworks  and  stratei^es.  The  results  are  also 
consistent  with  the  findings  of  Johnson  &  Plake,  1977;  Roper, 
1977;  &  Spock,  1987. 

On  the  other  hand,  strategy  feedback  was  less  effective  in 
learning  perceptual  strategies  than  in  learning  spatial 
strategies.  Moreover,  strategy  feedback  was  less  effective  than 
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solution  feedback  in  learning  the  perceptial  strategies  •  Ihat 
•more*  feedback  nay  have  no  effect  (Ktxlhavy,  1977),  or  an 
adverse  effect  (Rumelhart  &  Norman,  1978)  when  the  instruction 
tries  to  develop  different  or  difficult  f raaieworks  ajod/ar 
strategies  is  also  supported  ly  research  evidence  (Giloan, 
l^j  terriU,  1985;  Schoen,  1972;  Spook,  1937;  &  Steinberg, 

Comparing  the  results  of  the  interaction  detected  in  the 
stuc^  with  the  predicted  interaction  illustrated  in  figurt  :, 
ve  find  that  the  predicted  effects  of  strateg/  feedback  are 
confirxaed*  That  solution  f "^edback  would  be  less  effective  than 
strata^  feedback  when  tlic  leazner  is  instructed  in  strategies 
that  are  similar  to  hie/her  own  cognitive  strategies  is  also 
confirmed*  The  unpredicted  results,  however,  are  the  positive 
effect  of  solution  feedback  on  learning  strategies  that  are 
different  from  the  learner's  cognitive  strate^^es* 

It  may  be  noted  that  the  instructional  method  used  in  the 
study  was  the  guided  discovezy  method*  Tlie  entire  information 
given  to  the  subjects  was  in  the  form  of  questions*  The 
subjects  were  to  find  the  answers  to  those  questions  ly^ 
observing  exaiaples  of  the  problens*  The  process  of  guiding  the 
learner  into  discovering  features,  relationships,  and  rules; 
and  of  organizing  the  rules  to  efficiently  solve  the  problems, 
was  gradual*  It  is  plausible  that  providing  feedback  during  the 
process  of  discovexdng  the  new  perceptual  strategies  was 
interrupting  to  the  flow  needed  for  this  process*  Solution 
feedback  during  practice  may  have  confiTined  the  str^gies  the 
learners  were  able  to  discover  on  their  own  during  q^uistion* 
Merrill  (1935)  cited  evidence  for  the  effectiveness  of 
questions  on  discovery  learning,  and  for  the  ineffectiveness  of 
feedback  during  the  discovezy  process*  Ik>re  research  is  needed 
to  compare  the  effect  of  feedback  during  the  processes  of 
strategy  acquistion  and  practice* 

It  is  speculated  that  the  ineffectiveness  of  strategy 
feedback  in  learning  strategies  that  are  different  from  the 
learner  *s  cognitive  strategies  may  be  apparent  only  during  the 
preliminary  stages  of  learning*  However,  as  tlie  learner  starts 
to  reconstruct  his/her  cognitive  strategies  and  Btarts  testing 
them,  feedback  may  assume  its  corrective  function*  In  the 
present  study,  more  learners  indicated  a  change  in  the 
cognitive  strategies  they  used  to  solve  the  posttest  problems* 
Research  is  needed  to  compare  the  effect  of  strategy  feedback, 
and  solution  feedback  at  different  stages  of  an  extended 
instzn;iction*  Similar  research  is  also  needed  to  ccxapare 
feedback  effects  on  learners  with  low  and  higli  problem  solving 
skills,  on  learners  with  clear  cut  and  unclear  cognitive 
strategies,  and  cm  learners  who  are  confident  or  are  not 
confident  in  the  efficiency  of  their  cognitive  strategies* 
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It  is  of  interest  to  note  that  the  two  aajor  types  ri* 
strategies  iised  to  solve  three  tc  '-^series  probleos— spatial 
and  perceptual— were  reported  in  t;,^es  using  different 
prcblein  solving  tasks  (Greeno,  1975j  Larldn  et  al.,  1930;  Wood 
&  Shotter,  1973).  Reseach  is  needed  to  find  out  if  the  effect 
of  training  in  one        of  strategies  or  the  other  transferes 
to  different  problem  solving  tasks. 

Since  problem  solving  strategies  are  leamable,  and  since 
the  cognitive  strategies  the  learner  develops  aay  not  be 
efficient,  more  computer  assisted  instruction  is  needed  in  this 
area.  Instruction  on  strategies  of  problem  solving  vould  be 
based  on  measures  of  the  learner *s  costive  strategies.  A 
choice  of  strategy  feedback  or  solution  feedback  vould  depend 
on  the  efficiency  of  the  learner's  cognitive  strategies,  and  on 
lAetiier  the  strategies  to  be  learned  are  similar  to,  or 
different  from  the  learner's  cognitive  strategies. 
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Table  1. 

^feans  and  Standard  Deviations  of  the  Four  Treatment  Groups 


Treatment  Pretest  Posttest     Time  Correct  During 

Instruction 


Solution  Feedbacl^ 
opatial  strategies 
(n  =  13) 

27.60 

29.92 
(2.94) 

14.46 
(3.39) 

34.54 
(3.10) 

Solution  Feedback^ 
Perceptual  Strategies 
(n  =  16) 

24.56 
(5.59) 

29.81 
(2.43) 

14.43 
(3.52) 

33.81 
(4.64) 

Strategy  Feedback> 
Spatial  Strategies 
(n  =  17) 

26.18 
(4.95) 

30.65 
(1.19) 

18.57 
(2.58) 

37.81 
(1.84) 

Strategy  Feedback^ 
Perceptual  Strategies 
(n  =  19) 

24.63 
(5.96) 

28.26 
(4.43) 

22.53 
(3.91) 

36.42 
(2.74) 

Total  Mean  (n  =  65) 
Standard  Deviation 

25.62 
(5.39) 

29.60 
(3.13) 

17.40 
(5.13) 

35.73 
(3.61) 

Note:>iaximum  score  -  32  for  each  test,  42  for  instruction. 
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TalxLe  2. 

■Anaysis  of  Covariance  for  Posttest 


Source 

SS 

df 

m 

F 

Sig.  Level 

Within  CeUs 

it17.32 

60 

6.96 

.000 

Covariate 

155.61 

1 

155.61 

22.37 

Feedback 

.70 

1 

.70 

.10 

.75 

Strategies 

i 

-i.85 

.70 

.41 

Feedback^Strategies 

29.36 

1 

29.36 

A»22 

.04 
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figure  Captions 


Figure  1  •  Predicted  Interaction  Between  Feedback  and  the 
Learner's  Cognitive  Strategies. 

figure  2.  The  Interaction  Between  Feedback  and  the  Strategies 
it  Confirmed.  . 
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With  the  advent  of  the  information  processing  paradigm, 
researchers  interested  in  human  learning  often  consider  how 
strategies  used  in  programming  computers  are  analogous  to  certain 
mental  functions*    Drawing  on  this  computer  metaphor,  scientists  at 
MIT»s  media  lab,  including  Alan  Kay  and  Seymour  Papert,  are 
designing  instructional  strategies  for  using  computers  to  expand 
mental  functions  and  cognitive  flexibility  (Brand,  1987 )• 
Instructional  approaches  supported  by  Kay  and  Papert  focus  on  the 
development  of  parallel  mental  processes  used  to  recognize  patterns 
and  construct  relationships  in  the  visual  mode*    The  progress  that 
the  MIT  group  has  made,  with  the  computer-enriched  environment  at 
the  Hennigan  grade  school  in  Boston,  indicates  that  this  "right 
brain"  approach  to  instruction  may  offers  a  viable  alternative  to 
the  more  linear  approaches  used  in  traditional  language-driven 
instruction* 

Many  of  the  strategies  for  using  computer  graphics  to  develop 
constructive  mental  processes  focus  on  the  acquisition  of  cognitive 
abilities  by  depicting  stages  of  a  concept  or  event  in  an  iconic  or 
pictorial  format.    The  icons  used  in  this  type  of  instruction 
attempt  to  replicate  what  the  objects  or  events  would  look  like 
from  the  natural  perspective  while  the  relationships  between  the 
concepts  are  depicted  as  consequence  rather  than  process*  Thus, 
the  learners  are  left  with  the  task  of  comprehending  abstract 
relationships  which  may  not  fit  into  their  cognitive  schemata* 

ZUi  alternative  approach  is  to  identify  valid  cognitive 
processes  and  design  displays  which  elicit  affiliated  perceptual 
processes  through  tasks  which  require  mediation  of  relationships 
which  resemble  those  involved  in  the  targeted  cognitive  process* 
Once  elicited,  these  perceptual  processes  might  be  used  to 
facilitate  transfer  to  the  targeted  cognitive  processes. 

Psychobiographies  of  noted  intellectuals  (Shepard,  1978; 
Hadamard,  1945)  suggest  that  the  ability  to  mentally  construct 
images  which  possess  three-dimensional  properties  can  contribute  to 
creative  thinking*    For  example,  in  describing  the  thought 
processes  he  used  in  developing  "The  Special  Theory  of  Relativity," 
Einstein  explained  that  he  mentally  constructed  images  of  various 
objects  while  imagining  he  was  traveling  at  the  speed  of  light* 
When  what  he  observed  did  not  coincide  with  existing  theory^  he  was 
left  with  the  task  of  systematically  converting  what  he  had  "seen" 
into  mathematical  expressions*    Thus,  the  ingenuity  of  Einstein's 
discovery  was  more  dependent  on  his  ability  to  form  abstract  mental 
representations  of  an  idealized  world  than  on  his  expertise  in 
mathematics* 
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Einstein'r  imaging  ability  could  not  have  been  based  entirely 
on  environmental  equivalents,  because  no  such  equivalents  exist. 
Instead,  it  required  a  novel  construction  of  mental  representations 
on  the  basis  of  anticipated  changes  in  spatiotemporal  information. 
Mediated  displays,  which  require  the  learner  to  employ  such  process- 
es at  the  perceptual  level,  might  facilitate  the  development  of 
these  spatiotemporal  processes  and  thereby  contribute  to  creative 
thinking.    This  study  focuses  on  the  nature  of  the  processes 
involved  in  forming  mental  representations  from  different  methods 
of  depicting  complex  three-dimensional  objects  on  two-dimensional 
surfaces. 

Media  techniques  for  representing  the  interior  of  objects,  on 
the  limited  two-dimensional  surfaces  of  a  sheet  of  paper  or  video 
screen,  have  primarily  been  based  on  the  perception  principles  we 
use  to  identify  objects  in  the  real  world.    By  combining  ortho- 
graphic projection  with  surface  renderings,  color  and  shadowing 
techniques,  artists  can  depict  the  exterior  of  objects  as  trans- 
parent; thereby  revealing  various  interior  sub-components.  With 
the  addition  of  computer  animation,  these  three-dimensional 
depictions  become  more  convincing  when  the  objects  are  shown  as 
rotating  in  space.    However,  even  when  computer  animation  is  used, 
surface  based  depictions  can  not  adequately  represent  all  the 
interior  components  of  more  complex  objects  such  as  the  brain  or 
the  geological  structure  of  the  earth. 

A  commonly  used  technique  for  depicting  the  interiors  of  more 
complex  objects  is  to  present  the  object  as  a  sequence  of  cross- 
sections  or  slices.    In  neuroanatomy,  brain  slices  are  individually 
stained  and  converted  to  diagrams  which  are  presented  in  succession 
on  the  pages  of  an  atlas.    The  atlas  technique  requires  that  each 
diagram  have  a  separate  orienting  procedure  indicating  the  slicing 
axis  and  the  location  or  depth  from  which  the  cross-section  was 
taken.    While  some  learners  are  capable  of  using  the  atlas 
technique  to  construct  meaningful  images,  many  others  learners  have 
difficulty  integrating  the  procedures  for  mentally  combining  the 
individual  cross-sections.    A  technique  which  uses  computer 
graphics  to  display  the  cross-sections  in  continuous  succession  may 
provide  a  more  effective  means  for  developing  abilities  to  form 
mental  representations  of  three-dimensional  objects  with  complex 
interiors. 

The  processes  under  investigation  are  those  which  influence  the 
construction  of  mental  representations  from  a  sequence  of 
cross-sections  depicting  a  three-dimensional  object  traveling  in  a 
continuous  path  through  a  two-dimensional  plane  (see  Figure  1). 
The  viewer  of  this  dimensional  travel  display  must  therefore 
construct  a  mental  representation,  which  possesses  three- 
dimensional  properties,  on  the  basis  of  changes  which  occur  in 
two  dimensions  over  time.    Unlike  the  atlas  technique,  the 
dimensional  travel  technique  provides  the  opportunity  of 
constructing  the  three-dimensional  mental  representation  directly 
from  the  stimuli.    The  perceiver  can  act  on  the  incoming 
information  immediately  without  relying  later  on  strategies  for 
reconstructing  a  three-dimensional  image  from  a  series  of  memorial 
representations.    Thus,  although  the  processes  involved  in 
dimensional  travel  may  resemble  cognitive  imagery  processes,  they 
are  considered  perceptual. 
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Generalizing  Dimensional  Travel  to  Affiliated  Cognitive  Processes 

According  to  supporters  of  central  theories  of  perception 
(Fleming,  1987;  Rock,  1983;  Norberg,  1978;  Gregory,  1977), 
individuals  actively  construct  percepts  from  several  sources  of 
information  including  the  information  available  in  the  external 
world,  internal  feedback  and  previous  experience.    Central  theories 
acstune  that  there  is  a  reciprocal  interaction  between  perception 
and  cognition.    As  new  information  is  acquired  it  alters  the 
structure  of  internal  cognitive  schemata  which  in  turn  influences 
the  way  new  information  is  analyzed.      Norberg  (1966,  1978)  and 
Salomon  (1981)  have  argued  that  central  theories  are  more  viable 
guides  for  instructional  research  because  they  assume  perception  is 
a  constructive  process  that  can  be  controlled  by  the  viewer  and  not 
just  a  direct  apprehension  of  some  pre-existent  reality. 

In  addition  to  providing  a  new  means  of  conceptualizing  the 
interior  of  complex  objects,  the  processes  acquired  during  the 
viewing  of  the  dimensional  travel  displays  may  serve  to  elicit 
cognitive  imagery  skills.    Piaget  and  Inhelder,  contended  that 
perceptual  observations  serve  as  precursors  to  higher  order 
cognitive  processes.    For  example,  Piaget  (1966a)  claimed  that  a 
child^s  ability  to  anticipate  the  height  that  a  given  amount  of 
liquid  will  reach  when  poured  from  a  narrow  to  a  wide  glass 
(anticipatory  imagery)  is  in  part  dependent  on  the  child  having 
observed  similar  transformations  of  liquids  in  the  natural  world. 
This  ability  to  mentally  manipulate  perceptual-like  or  analog 
mental  images  has  also  been  linked  to  development  of  memory 
(Paivio,  1976;  Bower,  1972),  reasoning  skills  (Kaufmann  1979; 
Piaget  &  Inhelder,  1971;  Bruner,  Olver  &  Greenfeld  1966)  and 
creative  thinking  (Finke,  1980;  Shepard  1978;  Hadamard,  1945). 


Potential  Difficulties  in  Solving  the  Dimensional  Travel  Task 

This  study  is  exploratory.    It  is  designed  to  investigate  some 
of  the  strategies  which  different  learners  use  in  constructing 
mental  representations  from  the  dimensional  travel  display.  The 
shape  and  complexity  of  both  the  objects  displayed  and  the 
distractors  selected  for  the  forced-choice  alternatives  have  been 
designed  to  reveal  difficulties  which  learners  may  have  in  forming 
mental  representations  of  various  types  of  objects  presented  with 
the  dimensional  travel  display. 

The  participants  in  this  study  see  two  different  techniques  for 
depicting  three-dimensional  objects  on  a  two-dimensional  surface. 
One  method  is  the  dimensional  travel  display  which  is  a  dynamic 
depiction  of  the  surfaces  of  the  objects  and  their  interior 
components.    The  second  method  is  the  traditional  orthographic 
procedure  using  perspective,  hidden  lines,  surface  transparency  and 
shadowing  to  depict  the  objects  and  their  interior  components  in  a 
static  mode.     (Figure  2  shows  the  static  displays  of  the  forced- 
choice  alternatives  used  for  the  dimensional  travel  display 
depicted  in  Figure  1).    Thus,  the  recognition  task  requires  the 
subject  to  first  construct  a  mental  representation  of  the  three- 
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dimensional  object  based  on  observing  the  dimensional  travel 
display,  store  the  mental  representation  in  memory  and  then  decode 
it  in  order  to  identify  the  correct  option  from  the  orthographic 
projections  of  the  forced-choice  alternatives. 

Studies  of  anorthoscopic  (abnormally  viewed)  perception  (Aust, 
1984;  Rock,  1983)  have  found  that  simple  and  familiar  figures  are 
more  easily  recognized  than  complex  and  unfamiliar  figures. 
Anorthoscopic  perception  refers  to  the  ability  to  recognize  figures 
as  they  pass  behind  a  narrow  stationary  slit.    Recognition  of 
anorthoscopically  presented  figures  can  be  considered  as  a  problem 
of  recovering  a  two-dimensional  figure  from  the  motion  information 
viiich  takes  place  along  a  one-dimensional  slit.    The  assumption  is 
that  the  familiar  figures  assist  the  viewer  in  establishing 
hypothesis  for  constructing  the  mental  representations.    Thus,  when 
objects  are  presented  with  the  dimensional  travel  technique,  the 
simple  objects  should  be  snore  easily  recognized  than  the  complex 
objects.    However,  there  is  no  evidence  which  indicates  which 
aspects  of  object  complexity  present  the  most  difficulty  in  . 
mediating  a  dimensional  travel  display. 

The  shapes  depicted  in  this  study  were  all  regular  three- 
dimensional  translucent  solids:  spheres,  pyramids,  cubes, 
cylinders,  rectangular  solids  and  a  rotated  rectangular  solid 
described  as  a  diamond.    The  complexity  of  the  objects  was  based  on 
the  number  of  internal  solids  that  the  objects  contained,  the 
degree  of  embeddedness  and  the  shape  of  the  solids.    Five  levels  of 
object  complexity  were  identified.    The  simplest  level,  coded  0-0, 
was  a  medium  sized  solid  embedded  in  the  center  of  a  larger  solid. 
The  next  level  of  difficulty,  coded  0-0/0,  was  two  adjacc^nt  medium 
sized  solids  both  embedded  in  a  larger  solid.    The  third  level, 
coded  0-0-0,  was  a  small  solid  embedded  in  the  center  of  a  medium 
sized  solid  which    was  embedded  in  the  center  of  a  still  larger 
solid.  The  fourth  level,  coded  0-0/0-0,  was  a  small  solid  embedded 
in  a  medium  solid  which  was  adjacent  to  another  medium  sized  solid, 
all  of  which  were  embedded  in  a  larger  solid. 

The  most  difficult  level  of  object  complexity,  coded  0-C/D,  was 
based  primarily  on  shape  differences  (see  Figure  3).    All  of  the 
objects  in  this  level  were  embedded  in  the  center  of  a  rectangular 
solid.    The  internal  solids  in  these  objects  were  cylinders  and  the 
diamond  solids.    The  diamonds  were  actually  rectangular  solids 
which  were  rotated  so  that  the  facing  surfaces  were  90  degrees  from 
the  facing  surfaces  of  the  larger  rectangular  solid.    The  interior 
solids  were  all  the  same  length  and  height  with  a  horizontal  lei.gth 
equivalent  to  the  horizontal  length  of  the  larger  rectangular 
solid.    They  were  oriented  so  that  their  horizontal  center  lines 
were  parallel  to  the  facing  square  of  the  larger  rectangular  solid 
in  which  they  were  embedded.    Thus,  the  horizontal  center  line  of 
the  cylinder  was  parallel  to  the  slicing  plane.    In  this 
orientation,  the  cross-sections  of  the  diamond  solids  are  very 
similar  to  the  cross-sections  of  the  cylinders.    The  primary 
difference  relates  to  the  relative  depth  of  the  cross-sections. 


23 

40 


5 


When  the  cylinder  first  appears  in  the  display,  the 
cross  sectional  view  shows  a  somewhat  wider  band  than  the  diamond 
shaped  object.    This  is  because  a  greater  portion  of  the  cylinder's 
surface  is  tangent  to  the  slicing  plane.    If  the  cross-sections 
produced  by  the  diamond  solid  and  cylinder  are  compared  as  they 
move  through  the  slicing  plane,  the  height  of  the  respective 
rectangles  increase  at  a  different  rate.    When  the  diamond  solid 
passes  through  the  slicing  plane,  the  resulting  rectangle  increases 
at  a  constant  until  it  reaches  the  maximum  height  and  then 
decreases  at      constant  rate  until  the  solid  has  passed  through  the 
slicing  plane.    When  the  cylinder  passes  through  the  slicing  plane, 
the  change  in  the  rectangle's  height  is  initially  rapid.  The 
change  slows  down  as  the  maximum  diameter  is  reached  and  finally 
increases  again  before  the  cylinder  passes  completely  through  the 
slicing  plane. 

The  differences  between  the  way  the  cylinder  and  diamond  shape 
appear  as  they  pass  through  the  dimensional  travel  display  are 
subtle.    However,  they  are  crucial  to  understanding  the 
spatiotemporal  processes  required  in  mediating  th?  display  and  may 
reveal  a  preference  for  either  the  spatial  or  temporal  component. 
Learners  who  have  difficulty  identifying  the  difference  between  the 
two  displays  may  have  similar  problems  in  recognizing  sequential 
differences  in  an  atlas  of  the  brain  or  cross-sections  of 
geological  structures.    Deficiencios  in  mediating  these 
spatiotemporal  di^'ferences  might  serve  as  guides  for  redesigning 
presentation  strategies,  which  begin  with  the  obvious  and 
progressively  move  to  more  subtle  distinctions. 

Mental  Representations  Formed 
in  Solving  the  Dimensional  Travel  Task 

Studies  of  the  ability  to  mentally  rotate  figures  (Shepard  & 
Metzler,  1971)  have  found  that  the  time  it  takes  to  recognize  a 
rotated  figure  is  an  analog  of  the  number  of  degrees  the  figure  has 
been  rotated.    These  studies  provide  evidence  that  the  subjects 
were  mentally  rotating  visual  images  of  the  figures.  Other 
evidence  for  the  construction  of  visual  mental  representations  has 
been  found  in  studies  of  anorthoscopic  perception  (Aust,1984;  Rock, 
1983).    When  a  target  is  introduced  in  an  anorthoscopic  display  to 
indicate  the  speed  at  which  a  figure  is  moving  behind  a  slit  while 
the  actual  figure  speed  remains  constant,  the  length  of  the 
perceived  figure  increases  with  each  decrease  in  the  target's  speed 
and  decreases  with  each  increase  in  the  target's  speed.    Thus",  the 
nature  of  the  constructed  percept,  which  many  subjects  reported 
"seeing,"  was  influenced  by  the  both  spatial  components  as  revealed 
through  the  slit  and  the  temporal  components  indicated  by  the  speed 
of  the  moving  target. 

The  dimensional  travel  task  is  in  some  ways  similar  to  both  the 
mental  rotation  and  the  anorthoscopic  perception  tasks.  The 
orienting  processes  used  to  determine  the  axis  of  the  object  in 
relation  to  the  slicing  plane  are  similar  to  the  orienting 
processes  required  in  the  mental  rotation  task;  while  the  ability 
to  mentally  construct  dimensional  properties  on  the  basis  of  a 
sequence  of  slices  is  similar  to  the  anorthoscopic  perception 
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task.    If  subjects  who  view  the  dimensional  travel  display  report 
that  they  see  faint  copies  of  the  three-dimensional  objects,  this 
would  indicate  that  they  immediately  formed  a  perceptual- like 
mental  representation.     If,  on  the  other  hand,  they  report  using  a 
verbal  mnemonic  strategy,  some  level  of  prepositional  coding  would 
be  indicated. 

Another  way  of  investigating  the  nature  of  the  mental 
representations,  formed  while  viewing  the  dimensional  travel 
display,  is  to  look  at  what  type  of  errors  are  made.     Subjects  who 
rely  on  a  verbal  coding  strategy  for  remembering  the  internal 
components  of  the  objects  may  be  more  likely  to  make  errors  in  the 
embeddedness  or  order  of  the  object's  sub-components.    This  is 
because  they  must  first  decode  the  icons  from  the  dimensional 
travel  display  into  a  verbal  mnemonic  (e.g.  square  inside  triangle 
inside  circle) ,  remember  the  verbal  sequence  and  then  decode  the 
verbal  sequence  in  identifying  the  correct  orthographic  projec- 
tion.   On  the  other  hand,  subjects  who  rely  on  a  visual/holistic 
encoding  strategy  would  be  less  likely  to  make  an  order  error 
because  such  errors  usually  represent  a  radical  change  in  the 
visual  structure  of  the  object. 

For  example,  if  the  object  presented  in  the  dimensional  travel 
display  is  the  option  which  appears  at  the  top  center  of  Figure  4, 
the  option  at  the  bottom  center  is  one  of  the  order  errors  (both 
object  are  made  up  of  a  cube,  two  pyramids  and  a  sphere).    A  viewer 
who  uses  a  verbal  code  to  remember  the  secjuence  of  objects  com- 
ponents and  then  rearranges  the  sequence  during  storage  or  recall, 
might  consider  this  a  viable  alternative.    However,  if  the  viewer 
relies  entirely  on  a  visual/holistic  strategy  for  storage  and 
recall,  this  order  error  seems  much  less  viable  because  the  visual 
structure  is  radically  different  from  the  correct  option.  The 
visual/holistic  viewer's  errors  are  more  likely  to  be  represented 
by  the  position  error  at  the  top  right  of  Figure  4  which  is  a 
rotation  of  the  correct  option. 

Sex  Differences  in  Visual-Spatial  Abilities 

The  assumption  that  males  perform  better  than  females  on  some 
tests  of  visual  spatial  ability  has  been  supported  by  several 
researchers  (Conner  &  Serbin,  1977,  1985;  Lohman,  1986;  Maccoby  & 
Jacklin,  1974;  McGee,  1979).     Some  investigators  (Maccoby,  1966; 
Maccoby  and  Jacklin  1974)  have  found  that  the  most  marked 
differences  in  spatial  visualization  appear  after  the  onset  of 
puberty.    These  studies  suggest  that  differences  in  spatial  ability 
may  be,  at  least  in  part,  attributable  to  biological  gender 
differences.    Others  (Conner  &  Serbin,  1985;  Gagnon,  1985),  have 
found  that  training  in  visual-spatial  skills  benefits  females  more 
than  males. which  suggests  social  or  environmental  factors. 
Research  which  focuses  on  specific  visual-spatial  abilities,  such 
as  those  required  in  mediating  the  dimensional  travel  display,  may 
yield  strategies  to  accommodate  for  sex  differences  or  adji.st 
possible  sex  bias  in  instructional  procedures. 
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METHOD 


Subjects 

Student  volunteers  were  10  males  and  31  females  (mean  age  of 
24.1)  who  were  enrolled  in  education  classes  at  the  University  of 
Kansas . 

The  Dimensional  Travel  Display 

A  Silicon  Graphics  IRIS  computer  was  used  to  create  the 
dimensional  travel  displays  of  the  three-dimensional  objects. 
Mathematical  models  were  created  for  each  of  the  objects  using  the 
^graphics  tools  which  are  part  of  the  IRIS  system  software.  The 
obiects  and  sub-components  were  rendered  as  shells  with  white 
surSes    •  A  blue  opaque  plane  was  positioned       that  its  axis  was 
parallel  to  the  front  of  the  monitor's  screen.    When  an  object  was 
presented  in  the  dimensional  travel  display  it  was  initially  . 
^Ii?ioned  behind  the  opaque  fieM.      The  object  was  then  directed 
I?ong  the  Z  axis  so  that,  as  it  passed  through  ^he  slicing  plane 
the  outline  of  the  object's  surfaces  appeared  as  thin  lines.  The 
reLlt  was  a  dynamic  depiction  of  a  white  three-dimensional  object 
passing  through  a  blue  field.    The  monitors  m  Figure  1  accurately 

^^""fmete^rdes^gAed  to  indicate  the  depth  of  the  object  in  the 
Slicing  plane,  was  positioned  at  the  bottom  of  the  screen.    As  an 
objeJS  passed  through  the  slicing  plane  a  red  bar  moved  along  the 
meter  indicating  the  object's  depth  along  the  Z  axis. 

SnJe  tSe  g?lphics  had  been  created  on  the  IRIS  system  they  were 
transferred  to  videotape  using  a  Silicon  Graphics  genlock  board  and 
a  ?2nco  s^c  generator/encode?.    The  videotape,  which  was  f^^ited 
?or  ?estiS!  began  with  an  orientation  segment  showing  a  wire  frame 
Sree-Smensionll  object  passing  through  %tvo-dimensional  field 
while  the  function  of  the  metei  was  demonstrated.  The  orientation 
segment  concluded  with  a  sample,  item  which  was  ^JP^^^^^^tn^Dhasp 
the  dimensional  travel  objects  presented  during  the  testing  phase. 

The  testing  phase  of  the  videotape  consisted  of  '^^'"ensional 
trave"  displays  of  30  objects  (5  difficulty  levels  X  6  objects^. 
Each  dimenKoLl  travel  display  was  preceded  by  a  3  second  waru.ng 
that  the  "Object  is  Arriving,"  and  concluded  with  a  5  second 
cSStdo^  during  which  the  words  "Identify  Object"  appeared  on  the 
screen. 

The  Forced-Choice  Alternatives 

Orthographic  projections  of  the  objects  presented  in  the 
dimeSsiSSir?rave?  display  and  the  alternative  objects  wer^ 
using  super  Paint  software  on  an  Apple  Macintosh  II  computer. 
Shadowinq  techniques,  hidden  lines,  and  surface  transparency  were 
used  to  Leltfc^viAcing  depictions  of  the  three-dimensional 
objects.    The  object  renderings  were  then  incorporated  in  a 
HyperCard  program. 
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The  HyperCard  program  began  with  a  segment  which  complemented 
the  orientation  phase  of  the  videotape.    A  scenario  describing  how 
the  objects  had  been  lost  in  space  and  needed  to  be  recovered  was 
created  in  order  to  assist  the  subjects  in  developing  the 
hypothesis  that  three-dimensional  objects  would  pass  through  a  two 
Simensional  plane  described  as  "the  detector  ^jf    l^.^^f  ^,3^^^?""^° 
explained  that  it  was  their  task  to  identify  the  correct  object 
from  amongst  the  alternative  which  would  be  presented  on  the 
JompuSr  monitor  as  soon  as  the  object  had  passed  through  the 

^^""lach  of^th;  response  screens  included  six  forced-choice 
alternatives  -  one  correct  response  and  five  ^JJ^i actors  The 
rii.?i-r actors  were  selected  to  represent  three  different  types  01 
erroJs^s^Le!  position  and  order.     Shape  errors  were  ones  in  which 
It  ?el;t  one  of\he  solids  which  composed  the  fleets  was  of  a 
tSifferent  shape  from  any  of  the  solids  depicted  in  the 
cirrlspSnding  dimensional  travel  display  of  the  object.  Position 
e?ro?s  Sere  ones  in  which  all  solids  were  of  the  same  shape  but  the 
Ss?tLn  ol  the  internal  solids  was  re.ersea     O^^^/^f  ^^^^J^e^ 
Shen  the  level  of  embeddedness  and  size  of  the  solids  was  reversea 
hin-  thP  shape  and  number  of  the  solids  was  the  same.  The 
Sstra!to?f  we?^  counterbalancea  so  that  there  was  an  ""^^ 
of  Shape,  position  and  order  errors  (50  each)  for  the  thirty 
objects. 

Procedures 

Each  subject  was  individually  tested  by  either  a  male  or  female 
nh<.prvpr      The  videotape  was  presented  on  a  13"  video  monitor  which 
Sas  ^ocaied  ?o  Se  I'igh?  of  eSd  directly  adjacent  to  the  computer 
^nnnJo?      The  observer  prepared  the  videotape  and  HyperCard  program 
X  ^ed'the  It^jectlhrough  the  orientation  phase.    A  question  and 
Sswef  p2?od  wis  providel  both  before         after  the  sj^ject  saw 
the  sample  item.    Wien  the  subject  agreed  that  the  task  was 

understood,  testing  began.  ^v,«,7«h  a  nwaii-  to  Identify 

During  testing  the  computer  monitor  showed  a    Wait  to  identiiy 

Object"  screen  while  the  video  monitor  depicted  the  first 
dimensional  travel  object.    As  soon  as  ^^^f  ^j^^^^Jl? 

through  the  detector  field  on  the  video  "^^^^^J^^^^^  ^e^^ 
advanced  the  computer  program  to  display  the  forced  choice 
alternatives      The  subject  was  allowed  five  seconds  to  select  one 
of  the  six  oijecti  which  appeared  on  the  computer  screen.  The 
observe?  positioned  the  pointer  on  the  subject's  selection  and 
prelsel  the  mouse  which  automatically  recorded  the  sub ject^s  . 
?esDonse  and  advanced  the  program  to  the  next  "Wait  to  i^ientiiy 
Objec?"  s??een.    This  procedure  was  repeated  for  the  remaining  29 

informal  question  and  answer  discussion  followed  the 

?"  %£^te  J  l?Ldn^?yoruS%h^^^ftef  tf  hltry^u  see 
the°o?je^«    Spla?n  lll^yJll'/^nen  you  watched  the  objects  pass 
through  the  detector  field." 
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Analysis 

The  T-Test  procedure  found  in  the  SPSS  software  package  was 
used  to  compare  the  ability  of  males  and  females  to  correctly 
identify  the  objects  at  each  difficulty  level.    A  summary  of  the 
means  appears  in  Table  1.  Differences  were  not  significaait  at  any 
of  the  difficulty  levels.    A  review  of  the  means  indicates  that,  at 
least  at  this  adult  age,  females  may  have  no  more  difficulty  than 
males  in  identifying  the  objects  presented  with  the  dimensional 
travel  display. 

Because  the  alternatives  used  for  each  of  the  object  levels 
were  different,  tests  of  significance  were  not  used  to  compare  the 
error  types  or  object  difficulty  levels.    References  to  means  are 
used  as  general  indicators  of  performance.    The  mean  number  of 
correct  responses  for  all  object  levels  (M=  4.67  out  of  6  possible) 
indicated  that  the  subjects' were  capable  of  recognizing  many  of  the 
objects  presented  with  the  dimensional  travel  display.      There  was 
a  possible  tendency  to  make  shape  errors  (M=  .86)  over  order  • 
(M=  .24)  or  position  (M=  .22)  errors.    However,  this  trend  was 
primarily  a  reflection  of  the  responses  to  difficulty  level  five 
objects.    When  the  errors  made  on  the  first  four  object  difficulty 
levels  are  compared,  the  small  difference  between  the  mean  shape 
(M=  .03),  order  (M=  .18)  and  position  {M=  .27)  errors  did  not 
suggest  a  tendency. 

The  means  in  Table  1  provide  a  general  indication  that  as  the 
previously  identified  object  difficulty  level  increased,  the 
ability  to  recognize  the  correct  object  decreased.    The  most  marked 
decrease  in  ability  to  correctly  identify  the  object  occurred  at 
difficulty  level  five.    The  level  five  objects  were  the  ones  in 
which  the  subjects  had  to  differentiate  between  the  cylinder  and 
the  diamond  shape  solids.    At  level  five,  the  subjects  selected 
more  of  the  shape  distractors  (M=  4.20)  than  they  did  the  correct 
responses  (M=  1.25).    This  result  could  reflect  random  guessing 
because  there  were  four  shape  distractors  for  each  item  at  this 
difficulty  level. 

The  mean  number  of  correct  responses  for  the  first  four 
difficulty  levels  was  5.52  out  of  the  6  possible  for  each 
category.    This  indicates  that  adult  learners  were  able  to 
recognize  most  of  the  objects  presented  with  the  dimensional  travel 
display  when  the  shape  of  the  interior  solids  was  sufficiently  . 
different  so  as  not  to  require  extensive  reliance  on  the  temporal 
component.    That  is,  when  the  object  could  be  differentiated  from 
the  alternatives  on  the  bo.sis  of  remembering  the  outlines  in  a  few 
representative  slices,  the  subjects  were  more  likely  to  identify 
the  correct  alternative.    Whereas,  when  the  orientation  and  shape 
of  the  components  within  the  objects  produced  dimensional  travel 
displays  which  differed  primarily  by  the  rate  at  which  the  outlines 
were  revealed,  the  subjects  were  less  likely  to  identify  the 
correct  object. 
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The  assumption  that  the  subjects  relied  more  heavily  on  the 
spatial  component  than  on  the  temporal  component  was  also  evident 
in  their  descriptions  of  how  they  solved  the  task.    Out  the  41 
participants,  26  specifically  reported  using  internal  verbalization 
strategies  for  remembering  the  structure  of  the  objects.    A  typical 
comment  was,  "I  remembered  the  shapes  from  left  to  right.    I  would 
say  circle,  triangle,  square  or  whatever  and  then  I  would  look  for 
them  in  the  shapes  on  the  computer."    Other  subjects  reported  a 
similar  verbal  strategy  except  that  they  remembered  the  objects 
from  the  outside  to  the  inside.    When  these  subjects  were  then 
asked  to  explain  how  they  remembered  the  position  of  the  shapes 
they  would  typically  say  they  also  internally  verbalized  the  shapes 
from  left  x.b  right.    The  subjects  who  relied  on  internal 
verbalization  rarely  reported  using  the  meter  for  anything  more 
than  to  tell  when  the  object  was  about  to  leave  the  detector  field. 

A  few  of  the  subjects  reported  using  psychomotor  represent- 
ations of  the  objects'  components.    One  of  these  subjects 
explained,  "When  I  saw  a  circle  on  the  outside  I  would  make  a 
circle  with  aiy  first  two  fingers  and  then  the  next  shape  with  iny 
nex*-  finger  ...  I  put  the  shapes  on  the  left  in  my  left  hand  and 
the  shapes  on  the  right  in  my  right  hand."    One  subject  reported 
using  a  combination  of  internal  verbalization  and  psychomotor 
representation.    She  explained  that  she  would  say  the  shapes  to 
herself  and  then  tilt  her  head  in  the  direction  of  the  shapes. 

Only  7  of  the  41  subjects  specifically  reported  forming  iconic 
images  of  the  objects  while  viewing  the  dimensional  travel 
display.     These  subject  typically  said  they  made  a  picture  of  the 
object  in  their  mind  and  then  looked  for  the  picture  on  the 

computer  screen.  .  ,   •  „^ 

One  girl,  who  responded  correctly  to  all  of  the  options,  explained, 
"After  I  saw  the  first  one  (the  sample),  I  decided  to  make  a  _ 
picture  of  the  shapes  in  my  mind.     I'm  good  at  that  kind  of  thing 
but  I'm  glad  the  first  ones  were  easy  because  it  took  awhile  for  me 

to  get  the  hang  of  it  The  ones  with  the  cylinders  and  stuff  were 

the  hardest  but  after  I  got  it,  I  could  just  see  the  detector  field 
go  around  the  edges."    When  asked  if  she  used  the  meter  in  any  way 
she  replied,     "Well  I  didn't  watch  it  directly  but  I  think  I  was 
using  it  subconsciously...  I'm  glad  it  was  there.  I  think  it  helped 
me  see  the  objects." 

Discussion  and  Recommendations 

Because  advances  in  microcomputer  technology  have  only  recently 
made  this  method  of  presenting  three-dimensional  objects  practical 
in  instructional  settings,  there  were  no  existing  guidelines  for 
using  the  dimensional  -travel  technique  to  depict  complex  objects  or 
enhance  abstract  visualization  skills.    Nor  was  there  evidence  to 
indicate  which  type  of  learners  would  have  success  or  difficulty  in 
mediating  the  dimensional  travel  display. 
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other  studies  have  found  that  males  perform  better  than  females 
on  many  tests  of  visual/spatial  ability.    The  difference  between 
males  and  females  was  not  evident  in  this  study.    Perhaps  the 
spatiotemporal  skills  required  in  mediating  this  type  of  display 
are  sufficiently  different  from  the  skills  required  for  the  static 
tests  commonly  used  to  assess  visual  processing.  Another 
possibility  is  that  proficiency  in  internal  verbalization,  which 
many  of  the  subjects  reported  using,  may  have  offset  any  deficiency 
in  encoding  or  decoding  the  visual  components.    However,  these 
conclusions  are  tentative  because  of  the  limited  sample  size  and 
similar  research  using  larger  sample  sizes,  which  are  balanced  for 
males  and  females,  is  recommended. 

Differences  in  ability  to  mediate  the  dimensional  travel 
display  may  also  occur  at  different  developmental  levels.  Several 
researchers  (Cooper  &  Shepard,  1973;  Piaget  &  Inhelder,  1971; 
Rohwer,  1970;  Shepard- &  Podgorny,  1978),  have  contended  that  the 
ability  to  construct  and  transform  mental  representations  increases 
with  age.    A  previous  study  (Aust,  1984),  which  addressed 
spatiotemporal  processes  similar  to  those  required  for  the 
dimensional  travel  task,  found  that  anorthoscopic  perception 
followed  a  developmental  trend.    Findings  from  this  study, 
especially  those  which  relate  to  the  selection  of  objects  and 
orientation  of  the  slicing  plane,  will  be  used  to  refine  the 
procedures  in  making  the  display  appropriate  for  a  younger 
population.    Further  studies  with  a  younger  population  could  lead 
to  a  developmental  approach  for  training  in  spatiotemporal 

processing  ability.  _  .        .      ,  a.  -i 

The  most  difficult  aspect  of  mediating  a  dimensional  travel 
displays  involves  the  analysis  of  the  temporal  component.    If  the 
goal  is  to  explicitly  reveal  the  interior  components  of  complex 
three-dimensional  objects  to  the  broadest  range  of  learners,  the 
primary  factor  in  determining  the  orientation  of  the  slicing  plane 
should  be  based  on  differences  in  the  shapes  revealed  as  opposed  to 
differences  in  the  temporal  component  or  rate  of  revelation.  Fpr 
example,  the  cylinder  and  diamond  solids  would  have  probably  been 
recognized  by  a  broader  range  of  subjects  if  the  objects  had  been 
rotated  90  degrees  along  the  horizontal  axis  so  that  the  slicing 
plane  reveals  a  circle  and  diamond.    TVnother  procedure,  which  is 
presently  used  with  some  medical  technologies  such  as  MRI  or  CAT 
scans,  is  to  reveal  the' same  three-dimensional  object  using  several 
different  slicing  orientations.  ^  .     •  ^      4^  4.v,« 

However,  a  different  set  of  recommendations  are  m  order  it  tne 
instructional  goals  extend  beyond  simply  revealing  the  interior  of 
objects  to  the  development  of  abstract  reasoning  skills  in 
spatiotemporal  processing.    One  instructional  strategy  might  begin 
with  displays  of  objects  which  focus  primarily  on  the  spatial 
component  and  gradually  move  to  displays  which  require  more 
temporal  analysis.    This  strategy  could  be  augmented  by  moving  from 
exercises,  in  which  the  alternatives  are  presented  while  the  object 
is  being  revealed,  to  exercises  which  require  the  student  to 
remember  what  has  been  displayed  before  seeing  the  alternatives. 
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The  students  could  also  be  asked  to  generate  drawings  of  the 
objects  presented  in  the  dimensional  travel  display,  either  with 
paper  and  pencil  or  with  computer  drawing  programs.  Another 
possibility  is  to  provide  three-dimensional  transparent  objects  and 
have  students  make  a  sequence  of  drawings  to  represent  what  the 
object  would  look  like  as  it  travels^ through  the  detector  field. 

One  of  the  outcomes  of  the  computer  revolution  has  been  to  make 
us  aware  of  the  complexity  and  intellectual  sophistication  of  our 
perceptual  abilities.    Computer  scientists  have  created  machines 
capable  of  remarkable  feats  in  storing,  retrieving  and  manipulating 
both  graphic  and  verbal/mathematical  information.    However,  despite 
numerous  challenges,  they  have  been  unable  to  create  a  computer 
capable  of  reliably  differentiating  a  dog  from  a  cat  (Brand, 
1987).    Could  this  mean  that  the  seed  of  human  ingenuity  is  rooted 
more  deeply  in  our  perceptual  abilities  than  we  have  previously 

recognized?  . 

Paper  based  instructional  support  materials  have  led  to  a 
reliance  on  verbal/mathematical  systems  for  teaching  reasoning 
skills  -  possibly  because  it  was  less  expensive  and  faster  to 
present  ideas  in  words  and  numbers  than  it  was  to  produce  pictures, 
icons  or  animated  depictions.    As  we  move  from  paper  based  to 
electronic  based  instructional  support  materials,  students  will  be 
able  to  access  a  greater  variety  and  amount  of  information  ^n  much 
less  time  than  they  have  in  the  past.    However,  they  will  not  be 
adequately  prepared  to  enter  the  third  wave  information  society  by 
simply  applying  a  linear  approach  in  consuming  more  and  more 
information.    They  must  be-  able  to  select  relevant  information,  see 
novel  relationships  between  diverse  concepts  and  invent  new 
strategies  for  combining  a  variety  of  information  forms  in 
constructing  meaningful  wholes. 

continued  research,  which  yields  insights  into  the  way  we 
construct  meaning  at  the  perceptual  level,  will  asjsist  in 
developing  sound  foundation  for  addressing  these  abstract  reasoning 
skills.    A  more  comprehensive  plan  for  enhancing  perceptual 
abilities  may  result  from  this  research.    But  teachers  can  begin 
now  by  recognizing  the  importance  of  perceptual  abilities  while 
selecting  materials  and  developing  activities  which  encourage 
students  to  discover  original  ways  to  perceive  their  world. 
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Figure 


Dimensional  Travel 
Cube  Inside  a  Pyramid 


1 


Display  of  a 
Inside  a  Sphere 


The  above  figures  show  one  of  the  thirty  object  as  It  travels  through  the  dectector  field.  The 
meter  at  the  bottom  of  each  screen  Indicates  the  distance  that  the  object  has  passed  through  the 
screen.  In  this  case  the  three-dimensional  object  whlc^  is  passsing  through  the  screen  is  a 
cube  inside  a  pyramid  inside  a  sphere. 
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Figure  2 

The  Forced-Choice  Alternatives  for  the 
Dimensional  Travel  Display  Depicted  in  Figure  1 
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Figure  3 

The  Forced-Choice  Alternatives  for  the 
Level  Five  Objects 
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Figure  4 
Possible  Order  and  Position  Errors 
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Table  1. 

Mean  Error  Types  X  Object  Complexity  X  Sex 

 Error  Types  

Correct        Shape  Order  Position 

M  F         M  F         M  F         M  F 


0-0 

5.80 

5.81 

.10 

.09 

.10 

.09 

.00 

.00 

O-O/O 

W    W/  w 

o.  /  u 

0./  / 

no 

.UU 

no 
.Uo 

.30 

.16 

0-0-0 

^  R7 

nn 
.uu 

Ad 

.UU 

.1  d 

o-o/o-o 

4.80 

5.00 

.00 

.00 

.30 

.29 

.90 

.70 

0-C/D 

1.30 

1.19 

4.10 

4.30 

.60 

.42 

.00 

.00 

Totals  X  Sex 

4.64 

4.69 

.84 

.88 

.28 

.20 

.24 

.20 

Totals  All 

4.67 

.86 

.24 

.22  ' 

Level  1  (0-0  )  —  A  medium  sized  solid  embedded  in  the  center  of  a  larger  solid. 

Level  2  (0-0/0)  —Two  adjacent  medium  sized  solids  both  embedded  inside  a  larger  solid. 

Level  3  (0-0-0)  —A  small  solid  embedded  in  the  center  of  a  medium  sized  solid,  which  are  both 
embedded  in  a  larger  solid. 

Level  4  (0-0/0-0)  -A  small  solid  embedded  in  a  medium  solid  which  is  adjacent  to  another  medium 
solid,  all  of  which  are  embedded  inside  a  larger  solid. 

Level  5  (0-C/D) — Cylinoers  and  diamond  solids  embedded  inside  of  a  larger  rectangular  solid. 
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As  technological  processes  and  products  become  more  pervasive  in 
education  and  society,  it  is  becoming  increasingly  apparent  that  the  benefits 
of  educational  technology  are  often  distributed  unequally  and  that  individual 
and  social-group  differences  can  inhibit  access  to  the  technology  which  is 
available.  Research  and  development  in  educational  technology  ordinarily 
seeks  to  predict  and  measure  some  benefit  for  learners  from  the  use  of 
technology.  Such  research  and  application  efforts  may  actually  increase  the 
differences  between  the  "haves"  and  the  "have  nots." 

This  symposium  grew  out  of  a  series  of  conversations  among  the 
presenters  about  their  ongoing  research.  Each  appeared  to  the  others  to  be 
working  on  aspects  of  using  technology  to  address  some  social  "imbalance" 
or  to  investigate  die  effects  of  technology  which  might  inadvertandy  create 
such  an  "imbalance."  Some  of  the  issues  identified  included:  creating 
technological  dependency,  imposing  male  or  majority-group  values  on 
women  and  minorities,  and  ignoring  subtile  effects  of  communications 
technology.  The  papers  raise  questions  rather  than  provide  answers 
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The  Ethics  of  Technological  Intervention 
with  Disabled  Learners 


Richard  Howell,  Ph.D.,  The  Ohio  State  University 


The  advent  of  what  has  come  to  be  known  as  "new  technologies"  has 
served  to  open  up  new  avenues  for  communication,  mobility  and  physical 
interaction  by  disabled  individuals*  As  these  avenues  have  become 
incrcasuigJy  defined  and  made  available,  the  level  of  personal  independence 
of  the  disabled  user  has  evidenced  a  commensurate  increase.  But 
technological  advances  do  not  occur  in  a  vacuum,  they  occur  within  a 
particular  milieu  and  time.  Such  movements  tend  to  take  place  in  societies 
that  have  both  wealth  and  a  social  concience;  places  where  technological 
impetus  can  be  directed  toward  mote  "humanistfc"  goals.  But  no  society  can 
insure  that  progress  will  occur,  or  even  that  such  "progress"  is  in  the 
appropriate  direction!  The  disparity  in  societal  goals,  limited  willingness  to 
engage  energy  and  resources,  and  the  general  public's  lack  of  knowledge 
about  disabled  persons*  needs  cause  progress  in  designing  and  developing 
technological  answers  for  the  disabled  to  be  sporadic  and  lacking  overall 
direction. 

A  groundswell  of  activity  in  spedal  education  and  rehabilitation 
engineering  has  developed  a  wide  variety  of  assistive  devices  and  computer 
software  designed  to  meet  the  needs  of  an  e^  tn  wider  assemblage  of 
handicapped  users.  In  the  midst  of  the  burgeoning  research  and 
development  activities  comes  an  opportunity  to  re-examine  the  ethical 
implications  of  interventions  using  such  devices  in  the  delivery  of 
instruction*  It  is  important  that  ethical  issues  be  included  in  the  continuing 
dialog  between  the  instructional  design  community  and  those  involved  with 
the  education  of  disabled  learners.  There  are  several  perspectives  concaning 
the  appropriate  strategies  required  in  order  to  design  and  develop  quality 
instruction  for  disabled  learners.  Some  viewpoints  are  associated  with  the 
perspective  of  the  needs  of  the  "dominant"  culture  in  relation  to  a  specijd 
interest  subgroup;  and  others  from  the  perspective  of  a  disabled  individual 
with  abilities  that  can  be  enhanced  by  computer-  or  video-based  instruction. 
Regardless  of  the  perspective  taken,  each  one  imposes  requirements  and 
limitations  on  the  design,  development  and  implementation  of  assistive 
devices  and  software  for  the  disabled 

The  purpose  of  this  paper  is  to  discuss  a  few  of  the  more  pressing 
ethical  issues  associated  with  technological  interventions  and  disabled 
learners.  The  issues  raised  are  speculative  in  nature  and  are  meant  to 
encourage  further  questioning  rather  than  to  pose  solutions  to  immediate  or 
potential  problems.  Many  of  the  issues  are  the  result  of  questions  raised  in 
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the  design  of  research  being  conducted  at  the  Ohio  State  University-  This 
research  is  investigating  the  use  of  robotic  manipulators  on  the  cognitive  and 
affective  skills  and  aWlitJ-^s  of  severely  orthopedically  handicapped  children. 
Our  efforts  to  analyze  some  of  the  cognitive  and  affective  demands 
associated  with  technological  interventions  has  led  to  a  sobering  realization 
of  the  extreme  limitations  imposed  on  researchers  by  unreliable  and 
expensive  assistive  devices,  problems  with  accessing  these  devices,  and 
difficulties  in  training  teachers,  therapists  and  students  to  use  Ae  devices. 
The  discussion  that  follows  looks  at  a  few  key  issues  involving  tfie  role  of 
the  instructional  designer  in  the  process,  presents  a  proposed  model  for 
designing  technological  interventions  for  the  disabled,  and  some  final 
comments* 


Is  Technology  a  One-Way  Street? 

There  are  some  basic  conflicts  between  the  goals  and  needs  of  any 
society  and  those  of  its  minority,  or  special  needs,  groups.  One  conflict 
involving  the  disabled  and  the  larger  population  of  non-handicapped 
individuals  arises  firom  the  fact  Aat  most  technological  devices  are  designed 
and  built  with  the  physically-able  person  in  mind.  This  bias  permeates  all 
aspects  of  the  design  process,  evidencing  itself  in  restricted  access  from  the 
exterior  of  the  device,  and  limitations  within  the  device  that  make  it  difficult 
for  it  to  be  adapted  for  disabled  users,  Vanderheiden  (1983)  makes  a 
reasoned  plea  for  technological  "curb  cuts"  similiar  to  those  in  our  streets 
tliat  have  gradually  been  employed  to  allow  greater  access  by  wheelchair 
users.  He  advocates:  1)  the  initial  consideration  of  potential  disabled  users 
in  the  design  phase  of  equipment  development,  and  2)  the  incorporation  of 
adaptive  design  features  at  the  "circuit-board"  level  of  production.  This 
would  allow  for  both  inmiediate  access  to  available  peripherals  and  for 
future  peripheral  attachments,  board  expansions  or  display  adaptations 
necessary  for  a  variety  of  disabled  users,  Shworles  (1983),  a  quadriplegic 
rehabpitation  consultant,  cautions  us  ihat,  "The  vast  numbers  of  people  with 
disabilities,  the  extreme  variabilit}  from  one  disability  condition  to  Ae 
another,  and  the  complexity  and  fast-changing  nature  of  the  computer 
industry,  when  viewed  all  together,  reminds  us  that  the  national  challenge 
making  computers  accessible  is  only  beginning  to  be  done  and  could  fall  far 
short  of  being  a  job  well  done."  (p.  325), 


Realizing  Hopes  and  Dashing  Dreams. 

The  presence  and  use  of  computers,  video,  and  even  robots  with 
disabled  learners  has  evidenced  modest,  but  generally  positive,  results  in 
use  with  a  variety  of  handicapping  conditions,  ranging  from  the  mildly 
handicapped  (Hasselbring,  1987),  to  the  severely  orthopedically 
handicapped  (Leifer,  1983;  Howell,  Damarin,  &  Post,  1987),  However, 
these  initial  successes  belie  Ae  difficult  and  costly  developmental  effort  that 
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went  into  each  hardware  or  software  innovation.  They  also  do  not 
encompass  the  even  larger  number  of  studies  showing  no  significant 
effects,  studies  which  were  never  reported,  or  pilot  programs;  all  of  whose 
findings  are  valuable  for  the  field  but  are  never  disseminated  on  a  national 
basis. 

Another  serious  limitation  of  computers  and  other  technologies 
involves  the  length  of  time  it  will  take  for  some  innovations  to  reach  the 
marketplace  and  the  even  longer  time  for  many  of  tfie  devices  to  become 
affordable.  These  cautions  should  also  be  addressed  in  discussions  of 
potential  benefits  accruing  to  the  devices  in  onier  to  add  perspective  to  the 
real  costs  of  developing  and  adapting  devices  for  use  with  the  disabled. 


The  Instructional  Designer  and  the  Disabled  User 

There  is  a  surprising  congruence  between  the  conceptual  foundations 
that  under'-^  Instructional  Systems  Design  Theory  (Gagne,  1985)  and 
accepted  5;  Josophy  and  practices  in  special  education.  Such  critical  features 
of  the  instructional  design  process  as  the  identification  of  needs,  the 
specification  of  individual  goals  and  objectives,  and  the  formative  and 
summative  evaluation  of  progress  are  also  critical  features  of  special 
education  practices. 

However,  a  similarity  in  processes  does  not  guarantee  a  mutuality  of 
perspectives  concerning  the  importance  of  the  individual  in  the  learning 
process.  In  fact,  it  is  all  too  easy  to  minimize  or  even  forget  the  user  in  the 
design  process  once  the  needs  assessment  has  been  completed.  Too  often, 
the  results  of  the  assessments  become  isolated  pieces  of  data  in  the  design 
process  that  eventually  have  little  to  do  with  the  reality  of  Ae  changing 
person. 

Maintaining  an  awareness  of  both  the  cognitive  and  affective 
dimensions  of  behavior  is  considered  to  be  crucial  to  the  development  of  all 
instructional  products,  and  has  been  found  to  be  important  in  the 
development  of  effective  computerized  instructional  software  ODamarin, 
1987).  However,  even  the  most  optimal  design  will  always  be  a  reflection 
of  certain  assumptions  about  the  nature  of  learning,  the  role  of  the  learner 
and  teacher^  and  the  integration  of  materials  via  the  technological  delivery 
systems.  These  assumptions  almost  always  take  the  form  of  generalizations 
when  they  are  operationalized  into  an  educational  product  that  is  meant  to  be 
used  by  more  than  one  individual.  Thus,  the  more  information  the  designer 
has  about  the  characteristics  of  the  target  population(s),  including  psycho- 
motor, cognitive  and  affective  information,  the  more  appropriate  the 
technolgoical  intervention  will  be  for  use  by  a  variety  of  disabled  learners. 
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Designing  with  the  Disabled  in  Mind 


Burkman  (1987)  has  recently  proposed  a  "user-oriented  instructional 
design"  process  that  attempts  to  incorporate  the  opinions,  perceptions,  and 
acceptance  of  the  users  of  the  instructiona!  materials.  This  model,  if  applied 
with  a  few  modifications,  might  reasonably  meet  the  needs  of  the  disabled 
learner.  The  model  is  presented  below  and  includes  proposed  additions 
specific  to  the  disabled  learner.  Burkman  views  the  Potential  Adopter  of  the 
planned  product  as  "the  instructors  who  would  use  the  product";  the 
modified  procedure  appearing  here  presents  the  Potential  Adopter  as  a 
disabled  user  of  the  planned  productAechnology. 

Step  1:  Identify  the  Potential  Adopter  (PA).  Who  would  be  affected  by  the 
planned  product  if  it  was  to  be  adopted?  What  is  the  range  of  disabled 
individuals  who  can  potentially  use  the  product? 

Step  2:  Measure  Relevant  Potential  Adopter  Perceptions,  Includes:  1)  how 
PA*s  perceive  that  the  instruction  should  be  done,  2)  the  attributes  of 
instructional  products  that  they  perceive  to  be  important,  3)  the  specific 
aspects  of  physical  control  and  communicative  abilities  of  the  learner  brings 
to  the  task? 

Step  3:  Design  and  Develop  a  User-Friendly  Product.  This  includes  the 
use  of  the  instructional  design  procedures  developed  by  Gagne  (1985)  with 
two  modifications: 

1.  The  designer  attempts  to  incorporate  as  many  of  the  attributes  that  are 
valued  by  the  PA  and  tries  to  make  the  presence  of  the  attributes  as  apparent 
as  possible. 

2.  Evaluative  criteria  are  expanded  to  include  the  degree  to  which  the  PA:  1) 
perceives  the  product  favorably,  and  2)  tends  to  adopt  it  and  implement  it 
effectively. 

Step  4:  Inform  the  Potential  Developer,  Once  the  product  has  been 
developed,  inform  any  potential  developers  about  the  product,  stressing  its 
user-valued  attributes. 

Step  5:  Provide  Post-adoption  Support,  Once  adoption  has  occurred,  the 
teacher  or  instructor  must  be  given  the  tools  needed  to  implement  the 
product 

Instructional  tools  developed  through  processes  similiar  to 
Burkman*s  must  also  evidence  certain  characteristics  in  order  to  be  useful  to 
a  broad  range  of  disabled  persons.  In  general,  they  should  be:  1) 
adaptable  and  accessible  to  a  range  of  student  users,  2)  facilitate 
and  enable  cognitive,  affective  and  psychomotor  growth  on  the  part  of 
the  students,  3)  affordable,  in  terms  of  finanv  ial  and  logistical  costs 
(includes  training  and  maintenance  considerations),  4)  flexible  enough  to 
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allow  for  continual  refinement  when  subjected  to  formative  and  summative 
evaluations. 


Summary 

The  points  expressed  in  this  article  illustrate  the  dichotomous  reality 
of  contemporary  United  States  society  which  promises  equal  access  but 
tenders  only  ^dging  acceptance  of  its  disabled  members.  It  is  clear  that 
disabled  individuals  and  their  non-disabled  proponents  must  work  hard  to 
maintain  progress  that  has  been  won  in  the  past  and  move  forward  as  their 
energy  and  resources  allow.  Forward  to  a  future  that  is  bright  only  if  the 
design,  development,  and  utilization  of  enabling  technologies  are  seen  as 
"tools  for  independence  and  expression".  To  be  used  hi  the  disabled  person 
and  not  for  them. 

The  Instructional  Designer's  role  is  one  which  commonly  reflects  the 
values  and  mores  of  the  larger  culture  and  yet  must  also  transcend  the 
limitations  that  come  with  designing  for  the  majority.  This  requires  first  of 
all,  a  sensitivity  to  the  needs,  attitudes  and  desires  of  the  disabled  among  us. 
Secondly,  a  willingness  to  adapt  and  change  procedures  or  materials  to 
accomodate  the  needs  of  the  disabled  user.  Finally,  it  demands  that  the 
designer  maintain  a  constant  awareness  of  the  disabled  users  among  the 
potential  base  of  users  of  their  products. 

In  summary,  while  the  process  of  education  continues  to  evolve  with 
the  use  of  new  technological  systems,  the  basic  need  for  individual 
acceptance  and  respect  of  the  disabled  learner  should  remain  within  the 
focus  of  the  instructional  designer.  The  process  of  bringing  about  the 
changes  necessary  for  greater  independence  to  the  disabled  is  not  soley 
within  the  purview  of  the  instructional  design  community,  but  thdr  ability  to 
contribute  is  evident  Their  training  and  slaUs  provide  a  compatible  match  to 
those  of  the  special  education  and  therapeutic  communities  and  together  can 
provide  a  new  level  of  cooperation  in  developing  acceptable  technological 
answers  for  use  by  the  disabled  learner. 
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Issues  of  Gender  and  Computer  Assisted 

Instruction 

Suzanne  K.  Damarin,  The  Ohio  State  University 


The  purpose  of  this  paper  is  to  examine  strands  of  research  on  the  education 
of  girls  and  women,  and  to  analyze  implications  for  the  design  of  computer-based 
instructional  systems-  The  education  of  girls  and  women  has  been  studied  from 
the  perspectives  of  sex  differences,  gender  differences,  and  Feminist  studies;  the 
differences  in  these  perspectives  are  important  to  the  interpretation  of  findings. 

The  Education  of  Girls  and  Women 

Research  on  sex  differences  is  based  upon  an  assumption  of  biological 
deteraunism  (and  often  an  assumption  of  female  inferiority)-  These  studies  focus 
upon  the  measurement  and  genetic  explanation  of  differences;  their  findings  tend  to 
be  interpreted  to  educators  as  expectations  for  achievement,  rather  than  as 
prescriptive  in  any  sense.  Current  research  in  this  tradition  is  typified  by  the  work 
of  Benbow  and  Stanley  (1980, 1983), 

By  contrast  to  sex  differences  research,  research  on  gender  differences  and 
education  is  based  on  a  recognition  that  gender  is  a  social  construct  associated 
with,  but  not  identical  with,  tiic  biologicjd  fact  of  sex.  Therefore,  researchers  on 
gender  differences  attend  not  only  to  the  manifestations  of  cognitive  abilities,  but 
also  to  social  phenomena  in  the  classroom,  experiential  differences  between  girls 
aiid  boys,  attitudinal  and  emotional  alfferences,  and  the  relationships  between  and 
among  these  phenomena,  A  few  examples  from  the  numerous  findings  of  this 
research  are:  (1)  overt  and  subtle  sexism  in  classroom  materials,  (2)  differences  in 
the  amount  and  type  of  teacher  feedback,  (3)  differences  in  attitudes  of  students 
and  their  significant  others,  (4)  differences  in  math  anxiety,  (5)  differences  in 
optimal  learning  setting,  and  (6)  the  description  and  supplantation  of  cognitive 
effects  of  early  experience. 

While  researchers  m  the  traditions  of  sex  differences  and  gender  differences 
differ  in  their  willingness  to  accept  ability  as  biological*  and  immutable,  they  ^are  a 
willingness  to  accept  the  content  of  school  learning.  Feminist  educational  research 
is  based  upon  a  rejection  of  this  assumption;  researchers  working  from  ^e  feminist 
perspective  see  the  content  of  school  instruction  as  masculine  in  tfiat  it  has  been 
determined  by  male  values,  experiences,  and  intellect.  Therefore,  feminist 
educators  study  biases  within  the  selection,  ordering,  and  interpretation  of  topics 
of  instruction,  the  confounding  of  the  cognitive  and  affective  domains  in 
instructional  materials  and  evaluative  techniques,  and  even  the  definition  of  fields 
of  study  (e.g.,  "History  =  What  men  have  done  in  public."  Bezucha,  1985,  p.  84). 

It  should  be  noted  that  many  feminists  would  probably  consider 
Instructional  Design,  itself,  tu  oe  a  masculine  discipline,  which  incorporates  male 
values  hy  insisting  on  analytic  approaches,  orientation  towards  goals  rather  than 
processes,  and,  in  Turkle's  (1984)  term  "hard  mastery"  criteria  for  success. 
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Defining  Gender-Fair  ICAI 

Intelligent  Computer  Assisted  Instruction  (ICAI)  provides  a  model  through 
which  to  examine  more  carefully  the  issues  summarized  above.  ICAI  (also  know 
as  Intelligent  Tutoring  Systems  (ITS)  is  chosen  for  this  analysis  because,  at  least 
theorcticaUy,  it  incorporates  both  the  existing  models  for  computer  instruction  and 
the  promised  models  of  the  future.  Most  ICAI  schema  show  the  system  as 
composed  of  four  modules,  each  communicating  with  the  others  (Rambally,  1986; 
Wengerl987).  These  modules  are: 

Domain  Knowledge  Tais  module  is  an  "expert"  on  the  knowledge  that 

is  to  be  communicated.  It  provides  both  a  source 
of  knowledge  and  a  standard  against  which  to 
evaluate  student  knowledge.  It  can  engage  in 
dialogue  concerning  the  content  as  well  as 
criterion  referenced  measurement  of  student 
knowledge. 

Student  Model  Like  domain  knowledge,  this  module  is  an  expert 

system^  Ideally  the  n^el  includes  knowledge  of 
all  aspects  of  tne  student's  behavior  and 
knowledge  that  have  imi)lications  for  performance 
and  learning.  It  is  scxnetimes  called  the  diagnostic 
module. 


Pedagogical  Knowledge     Also  an  expert  system,  this  module  is  responsible 

for  decisions  concerning  the  presentation  of 
material  (e.g.,  branching,  frames);  it  ;iicludes 
knowledge  of  pedagogical  principles  which  are 
applied  to  infoimation  communicated  to  it  from  die 
E)omain  Knowledge  and  Student  Model  modules. 

Interface  This  module  is  responsible  for  communication 

between  the  pedagogical  module  and  the  student 
It  translates  machine  information  into  a  form 
understood  by  the  student  and  vice-versa. 

Each  of  the  modules  gathers  information  from  those  listed  before  it;  thus,  in  some 
sense,  th^  are  listed  in  order  of  importance  to  designers.  The  question  addressed 
below  is  the  implications  of  research  on  women  for  these  m^  nles;  a  comparable 
question  can,  and  should  be  asked  in  relation  to  each  of  ..linority  groups  in 
society. 

The  sex  differences  perspective.  Research  from  this  perspective  is  based 
upon  an  assumption  of  fixed  and  value-free  content  and  yields  replicated 
differences  between  the  sexes  in  mathematical,  verbal,  and  spatial  abilities,  as  well 
as  in  aggressiveness;  several  other  variables  of  potential  difference  have  been 
explored  with  mixed  results  (Maccoby  and  Jacklin,  1974;  Fausto-Steriing,  1985). 
Attention  to  improving  the  mathematics  instruction  of  girls  and  women  by  adoption 
of  this  point  of  view  requires  that  these  variables  be  addressed  in  the  developmcLit 
of  ICAI  as  follows: 
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Knowledge  Domain: 


Student  Model: 


Sex  is  irrelevant  to  the  content  and  to  its 
organization. 

Sex  is  relevant  to  student  perfonnance  and 
must  be  a  pan  of  ii^e  model 


Pedagogical  Knowledge:      Aggressiveness  required  of  student  may  be 

relevant  to  the  selection  of  appropriate 
teaching  strategies. 

Interface:  Use  of  verbal,  symbolic,  or  spatial 

representation  of  knowledge 
may  be  differentially  appropriate  to  students 
based  upon  sex* 

The  major  implications  for  instructional  designers  lie  in  the  area  of  needed  research, 
and  that  research  would  appear  to  lie  largely  in  the  direction  of  "how  can  expert 
systems  incorporate  teaching  and  communication  strategies  which  arc  maximally 
effective  for  girls?" 

The  gender  differences  perspective.  The  implications  of  gender 
differences  research  for  ICAI  are  considerably  mo:e  complex,  in  part  becaiisft  Uti^y 
affect  the  Knowledge  Donudn*  This  research  has  ^implications  for  both  the  selection 
and  organization  of  information,  and  for  other  elements  of  ICAI  as  follows: 

Knowledge  Domain:         (1)  Expand  the  content  c'jomain  to  include  information 

relevant  to  women's  learning,  (2)  Contract  the 
content  to  exclude  sexist  examples*  (3)  Organize  the 
content  to  allow  mott  diverse  rnodes  of  querying* 

Student  Model:  Sex  of  stud(;nt  is  a  relevant  variable  and  has 

interactions  with  attitudes,  anxiety,  motivation, 
encouragement  from  significant  others,  which  are  also 
relevant  variables* 

Pedagogical  Knowledge:     Include  strategies  for  cooperative  learning,  at  least  at 

the  level  of  concept  development*  Eliminate  sexism 
from  examples* 


Interface: 


No  clear  implications* 


The  Hndings  from  research  on  gender  and  ethnic  differences  in  learning  are  quite 
complex  in  their  implications  for  c>onstruction  of  a  Knowledge  Domain  and  a 
Student  Model*  Different  lines  of  gender  research  suggest  the  addition  of  spatial 
infomuttion,  historical  information,  metacognitive  strategies,  and  metamathematical 
advice  to  the  Kr?,owledge  Domain;  addition  of  these  types  of  information  would 
require  different,  and  periiaps  conflicting,  OTganizations  of  knowledge* 

An  argument  can  be  made  tiiat  (human)  teachers  call  upon  at  least  two 
content  relevant  Knowledge  domains:  knowledge  of  die  content  and  knowledge 
about  the  content  The  latter  dcxnain  includes  such  information  as  die  prevalence  of 
particular  errors,  a  typology  of  errors,  referents  to  knowledge  oiuside  the  given 
domain,  useful  analogies,  rmscellaneous  motivational  ideas,  jokes,  etc*  Tlie  logic 
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underlying  access  and  use  of  Knowledge  about  mathematics  is  entirely  different 
from  the  deductive  logic  of  mathematics.  Perhaps,  if  ICAI  is  to  be  made 
responsive  to  issues  raised  by  researchers  on  gender  and  mathematics,  it  must  be 
conceptualized  as  having  two  Knowledge  Domaias:  Knowledge  of  Mathematics 
md  Knowledge  about  Mathematics. 

Regardless  of  whether  and  how  information  about  mathematics  is  included 
in  ICAI,  there  remains  the  question  of  how  the  information  of  mathematics  should 
be  organized  in  a  Knowledge  Domain.  Researchers  on  children's  play  suggest  that 
boys  and  girls  build  different  cognitive  structures  based  upon  their  play  activities, 
and  that  tiiese  structures  are  differentially  useful  for  organizing  mathematical 
information*  Studies  of  Native  American  children  (Garbe,  1973)  and  of  Oriental 
graduate  students  (Damarin  and  West,  1979)  indicate  the  existence  of  cultural 
differences  in  the  relative  importance  of  particular  concepts  to  students  in  full  or 
partial  command  of  a  body  of  mathematics*  Damarin  (in  prepO  provides  a  rationale 
for  expecting  some  similar  differences  between  male  and  female  children  as  they 
study  fractions.  The  implication  of  these  studies  is  that  the  organization  of  concepts 
in  ICAI  must  be  fluid  rath^  than  fixed,  giving  learners  the  opportunity  to  structure 
their  own  knowledge  in  a  manner  consistent  with  their  own  linguistic  and  cognitive 
structures. 

The  challenges  posed  for  ICAI  designers  by  research  on  gender  differences 
arc  fundamental  to  the  design  of  the  Knowledge  Domain.  Gender  differences 
research  also  has  implications  for  the  Student  Model  and  the  Pedagogical 
Knowledge  modules.  Some  of  these  implications  are  demands  for  research;  little  is 
known,  for  example,  about  how  math  anxiety  interacts  wiA  subject  matter 
specifics,  nor  about  how  one  would  use  anxiety  information  to  modify  instruction. 
The  finding  that  girls  leam  initial  concepts  more  effectively  in  cooperative  learning 
settingr^  (Fennema  and  Peterson,  1986),  raises  a  constellation  of  questions  for 
ICAI. 

It  should  also  be  noted  that,  because  the  compute/  r  ^  i  be  dispassionate, 
ICAI  could  be  quite  useful  in  correcting  some  gender-based  inequsdities  in 
education.  Girls  and  boys  should  expect  equal  amounts  of  task  relevant  feedback, 
and  both  should  work  with  examples  which  are  not  laden  with  sexist  connotation. 

The  Feminist  Perspective.  The  attempt  to  bring  together  ideas  from 
feminist  educational  theory  and  an  advanced  model  for  instructional  design  is, 
perhaps,  tantamount  to  heresy  in  both  fields.  Nonetiieless,  the  generality  claimed 
for  tht*  ICAI  model  by  educational  computing  enthusiasts,  and  the  ubiquity  of  inale 
influence^  as  elaborated  by  feminist  researchers,  invites  a  joint  analysis  of  tiiese 
positions.  A  preliminary  summary  of  implications  of  feminist  theory  for  the 
elements  of  the  ICAI  model  is  as  rbllows: 

Knowledge  Domain:         Knowledge  is  never  value-free:  content  and 

organization  of  this  domain  should  allov/  querying  of 
values.  Content  and  its  organization  should  reflect 
variety  in  the  ways  of  knowing. 

Student  Model:  All  students  are  products  of  a  patriarchal  society. 

Rules  for  behavior  (including  cognitive  behavior)  are 
gender-related  and  relationships  betA^een  knowledge 
and  behavior  are  knowledge-variant.  Students  vary  in 
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their  acceptance  or  rejection  of  the  values  inherent  in 
the  Knowledge  Domain* 

Pedagogical  Knowledge:    Each  teaching  strategy  embodies  elements  of  an 

educational  philosophy;  selection  of  strategies  also 
reflects  a  philosophy  of  learning  and  of  the  teacher 
role.  These  philosophies  must  be  articulated  and  allow 
querying. 

Interface:  Natural  language,  itself,  has  masculine  connotations. 

These  connotations  often  preclude  the  translation  of 
machine  information  in  such  a  way  as  to  communicate 
neither  more  nor  less  than  the  meaning  of  the  machine 
language.  Such  translation  should,  however,  be  the 
goal. 

The  issues  raised  in  this  summary  are  many  and  they  are  related  to  ail  components 
of  ICAI;  the  depth  of  these  issues  is  illustrated  by  a  single  example.  Sherry 
Turide's  (1984)  analysis  of  adolescents  worto'ug  with  Logo  leads  her  to  discuss  the 
concepts  of  "hard  mastery,"  a  kind  of  technical  mastery  of  Logo  which  is  associated 
with  the  masculine,  and  "soft  mastery,"  a  more  intentional  mastery  of  the  language. 
At  the  same  time,  Wenger  <1987,  p.  149,  p.  425)  observes  that  Logo  provides  a 
good  paradigm  for  some  aspects  of  ICAI.  Bringing  this  work  together  implies  that 
criterion  referenced  evaluation  within  a  Logo  Knowledge  Domain  should  not  be 
based  solely  upon  technical  proficiency  with  the  language,  but  must  also  reflect  the 
individualistic  and  creative  work  done  by  those  in  "soft  mastery"  of  Logo.  These 
same  considerations  have  implications  for  the  Student  Model,  and  for  the  design  of 
ICAI  well  beyond  the  Logo  environment 

Conclusion 

This  paper  provides  a  framework  for  comparing,  contrasting,  and  in  some 
cases,  combining  problems  m  instructional  design  with  issues  in  the  education  of 
girls  and  women.  The  framework  serves  to  structure  several  issues  for  further 
analysis.  It  is  important  to  note  that  some  issues  of  importance  both  to  the  design 
of  compuf^r-based  instruction  and  to  the  instruction  of  girls  and  women  fall 
outside  this  framework.  For  example,  there  is  mounting  evidence  (CoUis,  1987; 
Hawkins,  1987)  that  girls  transfer  mathematics  anxiety  to  computer  anxiety.  One 
implication  of  this  finding  might  be  that  ICAI  is  less  appropriate  for  those  girls 
than  it  is  for  boys;  an  alternate  inq)lication,  and  one  that  is  more  difficult  to  pursue, 
is  that  ICAI  must  become  more  responsive  to  the  needs  of  girls  and  women  than 
traditional  mathematics  instruction  has  been.  The  analysis  above  points  out  how 
complex  a  task  this  would  be. 
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Equity,  that  which  is  judged  to  be  just  or  fair,  is  presumed  to  be  a  good 
thing.  Equality,  having  the  quality  of  of  being  equal,  also  is  presumed  to 
have  a  universal  goodness  inherent  in  its  delinition.  However,  when 
examined  fix)m  a  variety  of  perspectives,  the  terms  equity  and  equality 
define  related  but  different  constructs  whose  pursuit  can  present  some 
ethical  and  educational  considerations.  If  we  are  concerned  about  women 
having  skills  equal  to  those  of  men,  are  we  then  not  valuing  those  sidlls  that 
are  different  firom  men?  And  if,  for  instance,  there  is  some  evidence  that 
there  is  a  lack  of  equal  ability,  then  individuals  who  manifest  less  of 
whatever  is  being  measured  are  quickly  labeled  as  having  a  deficit  (as 
opposed  to  those  who  have  more  being  labeled  as  having  a  surplus). 
Equity,  cn  the  other  hand,  fosters  fairness  m  opportunity.  In  our  system  of 
education,  anyone  has  the  right  to  develop  aptitudes  and  abilities  to  their 
fiillest  potential.  It  is  only  just 

This  paper  discusses  one  such  aptitude,  visual-spatial  learning,  and  some 
of  the  equity  issues  which  are  linked  with  it  It  then  outlines  a  program  of 
research  which  miglit  resolve  some  of  the  issues  and  exacerbate  oAers.  It 
sketches  some  of  the  ethical  implications  of  the  positions  in  tihe  issues,  and 
suggests  dimensions  which  should  be  considered  in  research  in  order  to 
ensure  that  the  complex  array  of  equity  issues  can  be  addressed. 


Equity  Issues 

Fewer  women  rhan  men  enter  professions  which  are  built  on 
mathematics  and  the  physical  sciences.  There  are  muiiy  hypotheses  for  this 
phenomenon.  A  report  by  Lantz,  Carlberg,  and  Eaton  (1982)  cites  three 
major  areas  of  differences  between  women  choosing  science  and 
engineering  and  other  women:  interest,  ability,  and  educational 
experiences.  Women  choosing  careers  in  science  and  engineering  are  more 
interested  in  things  than  people  and  had  more  interest  in  mathematics  and 
science.  These  women  also  tend  to  score  higher  on  measures  of  abUity, 
including  verbal  and  mathematical  aptitude,  spatial  visualization,  science 
achievement,  and  grade  point  average.  Educational  experiences,  as  pointed 
out  by  the  authors,  are  probably  a  result  of  the  combination  of  the  first  two 
factors.  Women  scientists  and  engineers  have  more  formal  education  in  the 
sciences  through  increased  choice  of  math  and  science  courses,  and  they 
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also  have  more  informal  experiences  with  math  and  science  because  of 
participation  in  science  clubs  and  hobbies. 

Spatial  visualization  and  orientation  have  shown  to  have  strong  predictive 
validity  for  estimating  success  of  individuals  in  tiie  fields  of  engineering, 
science,  draftin;^,  and  designing  (McGee,  1979).  It  is  no  surprise, 
therefore,  that  fewer  women  are  in  these  fields  since  they  also  tend  to  score 
lower  than  men  on  visual  spatial  aptitude  measures. 

How  docs  this  happen?  Sex  related  diflFerences  don't  become  reliable 
until  puberty,  and  then  the  difference  become  obvious.  McGee  (1979) 
discusses  four  possible  sources  of  variance  in  spatial  test  scores: 
environmental,  genetic,  hormonal,  and  neurological  influences.  Some  posit 
that  women  are  socially  encouraged  to  be  more  nurturing  and  dependent 
upon  human  interaction.  And  whatever  the  reason,  many  girls  and  women 
perceive  mathematics  and  science  to  be  the  domains  of  males.  A  third 
explanation  might  be  that  schools  and  teachers  subtiy  or  blatantiy  advise 
girls  and  young  women  away  fix)m  scientific,  mathematical  or  technical 
studies.  Genetic  influences  arc  yet  to  be  proven,  although  there  is  some 
evidence  that  spatial  abilities  are  probably  as,  or  more,  heritable  as  verbal 
ability.  Hormonal  influences  such  as  an  estrogen-androgen  balance  are  also 
ccMisidered  as  a  factor,  but  like  the  question  of  genetic  influences,  this  factor 
needs  much  more  empirical  evidence.  On  the  other  hand,  neurological 
influences  do  appear  to  be  strong.  These  influences  center  upon 
hemispheric  q)ecialization,  and  two  issues  continually  arise  in  studies:  (a) 
the  right  hemisphere  specializes  in  spatial  processing  and  (b)  males  have 
more  hemisphere  specialization  than  females. 

Educators  have  no  control  over  genetic  and  hormonal  influences;  and 
given  the  opportunity  to  sthicture  learning  experiences  for  hemispheric 
activity,  perhaps  educators  have  a  little  influence  on  neurological 
development  Our  major  arena  of  influence  is  the  educational  environment- 
social,  cunicular,  instructional,  and  affective  influences  of  everyday  school 
life.  Another  plausible  reason  for  lessened  spatial  skill  development  in 
females  is  that  women  have  been  educated  to  use  a  type  of  thinking  which  is 
not  the  most  productive  in  learning  these  subjects. 

Most  education  is  based  on  language-based  learning.  In  language-based 
learning,  ideas  are  expressed  as  a  If  near  sequence  of  related  propositions 
Oust  as  tiie  ideas  presented  in  this  paper  are  formulated).  Girls  in  the 
prinnry  and  intermediate  grades  excel  in  this  form  of  learning  and  thus 
demonstrate  superiority  on  most  instructional  tasks  presented  in  the  first  half 
of  elementary  and  secondary  schooling.  There  is  a  great  deal  of  conjecture 
as  to  whether  this  superior  performance  results  from  a  natural 
developmental  capability  or  whether  it  results  fix)m  the  social  and  cultural 
differences  in  experiences  which  young  girls  have.  At  the  very  least, 
superiority  in  language-based  learning  probably  influences  girls  to  rely  on 
their  success  and  to  avoid  or  igj^ore  experiences  which  require  other  types 
of  cognition. 
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Visual-spatial  learning  is  multidimensional  and  simultaneous.  Such 
learning  cannot  be  expressed  adequately  in  language.  It  is  involved  in 
problem  solving  of  all  types,  but  .  is  especially  important  in  scientific 
problem  solving  in  which  a  complex  array  of  variables  interact  with  each 
other.  Visual-spatial  thinking  may  involve  multidimensional  visual  arrays 
(when  these  are  restricted  to  three  dimensions  one  is  dealing  with  pictures) 
or  may  involve  multidimensional  arrays  or  networks  of  data.  People  who 
learn  and  think  using  visual-spatial  processes  sometimes  do  not 
communicate  these  ideas  in  traditional  ways  making  assessment 
problematic. 

Gagnon  (1985)  and  others  (  Fiostig,  1972;  Salomon,  1979)  have  found 
that  it  is  possible  in  a  relatively  short  time  to  train  women  in  visual-spatial 
thinking  to  a  level  of  parity  with  men.  In  fact,  Gagnon  found  that  men  who 
experienced  the  same  treatment  did  not  make  sigifecant  gains.  This  study, 
conducted  on  college  students  (as  are  so  many  of  our  studes),  suggests  that 
remediation  of  the  cognitive  skill  of  visual-spatial  learning  is  relatively 
simple.  It  does  not  address  the  issue  that  by  the  time  a  woman  had  entered 
college,  there  h?.ve  been  all  sorts  of  learning  opportunities  lost  because 
upper  elementary  and  high  school  females  do  not  manifest  a  high  level  of 
performance  in  visual-spatial  thinking. 


Program  of  Research 

Boys  and  girls  have  been  measured  to  have  parity  in  visual-spatial  skills 
until  they  reach  early  adolescence  although  variations  in  performance 
alternatively  favoring  girls  and  boys  make  the  picture  rather  complex.  It  is 
at  the  time  of  puberty,  however,  that  visual-spatial  performance  of  boys 
begms  to  be  measured  consistently  higher  than  that  of  girls.  Since  there  is 
no  evidence  that  some  earlier  experience  of  the  boys  might  contribute  to  the 
results  measured  much  later,  it  seems  reasonable  to  study  whether  some 
intervention  in  the  fourth,  fifth  or  sixth  grades  v/ould  maintain  parity  for  the 
females  and  whether  such  parity  was  a  positive  influence  on  Sieir  learning 
mathematical  and  scientific  concepts  or  their  attitudes  regarding  these 
subjects.  In  addition,  longitudinal  studies  would  be  required  to  ascertain 
whether  pre-pubertal  intervention;  vTill  be  sufficient  or  whether  continuing 
intervention  will  be  required  throughout  middle  and  high  school. 

Should  the  visual-spatial  experiences  be  prepared  as  integral  to  the 
mathematics  and.  science  curricula  or  should  they  be  ^leveloped  as  specially 
focused  exercises  just  for  the  females.  Research  needs  to  be  conducted  to 
find  out  whether  integrated  curricular  experiences  can  be  developed  which 
are  perceived  by  teachers  to  be  "covering"  the  expected  curriculum  at  the 
same  time  that  they  are  encouraging  development  of  visual-spatial  thinking. 
Can  these  experiences  be  motivating  to  females?  Will  the  experiences  have 
more  powerful  effects  on  the  males  (the  rich  get  rici^  yr  problem)  or  will  such 
experiences  slow  the  intellectual  development  for  fhoml 
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Will  teachers,  who  being  mostly  female  do  not  understand  visual-spatial 
thinking  well  themselves,  be  able  to  guide  the  learning  of  visual-spatial 
thinking  by  bemg  sensitive  to  the  subtile  cues  of  translation  of  visual  tasks 
into  propositional  tasks  (an  inefficient  process  often  used  by  girls  when 
confronted  with  a  ^atial  task).  How  can  teacheiTs;  best  be  encouraged  to 
develop  visual-spatial  thinking  themselves.  Can  iiity  experience  powerful 
effects  of  their  own  visual-spatial  thinking  in  their  management  of  complex 
classroom  environments?  What  sort  of  support  system  wUl  be  necessary  to 
encourage  commiJment  to  visual-spatial  matters  after  the  novelty  weais  off? 

How  can  social  and  cultural  factors  in  the  differential  rearing  of  boys  and 
girls  interact  with  the  cognitive  and  manipulative  experiences  in  visual- 
spatial  thinking  to  ei  liance  the  abiL'ties  of  females  in  scientific  and  technical 
study.  Can  curricula  in  mathematics  and  science  be  developed  which 
construct  meaning  in  ways  more  in  harmony  widi  feminist  culture?  Can 
examples  and  problems  be  developed  which  will  both  be  interesting  and 
motivating  to  females  and  be  stimulating  of  visual-spatial  thinking? 


Ethical  Analysis 

There  would  seem  to  be  litfle  doubt  that  a  person  should  be  able  to 
function  as  well  as  her  or  his  biology  allows.  Yet  social,  cultural  and 
economic  factors  have  served  to  limit  people  not  only  in  accessing  the 
means  for  the  development  of  capability  but  also  have  focused  mdividuals 
or  groups  on  particular  goals  and  aspirations.  Contemporary  society  has 
increasingly  voiced  the  goal  of  removing  barriers  to  individual  development. 
In  addition,  the  increasing  dependence  of  all  on  the  products  of  technology 
has  increased  the  importance  of  scientists,  engineers,  technicians,  technic^ 
writers,  and  technical  managers  for  the  maintenance  of  convenience, 
comfort  and  (we  hope)  quality  in  life. 

Women  comprise  slightiy  more  than  half  of  the  population.  Yet  women 
represent  a  small  minority  in  scientific,  technological  and  management 
fields.  Some  might  claim  that  women  have  other  very  significant  roles  in 
society.  Yet  there  is  widespread  evidence  that  these  "other"  roles  for 
women  are  neither  valued  by  being  powerful  nor  by  being  well-paid.  It  is 
surely  too  simplistic  to  claim  that  women  are  so  underrepresented  in  science 
and  technology  because  they  perform  less  well  in  visual-spatial  thinking, 
but  if  visual-spatial  thinking  is  a  factor,  isn't  it  appropriate  that  educators 
and  educational  researchers  should  work  to  provide  experiences  for  female 
learners  to  eliminate  it? 

Dugger  (1986)  feels  that  equity  is  a  matter  of  balancing  a  variety  of 
possibilities  for  the  individual  regardless  of  the  gender  of  the  individual  or 
the  traditional  gender  association  of  that  trait.  Under  the  disciplme  of  this 
position,  while  girls  were  being  encouraged  to  learn  and  use  visual-spatial 
skills,  boys  would  be  learning  nurturance  or  some  other  helpful,  positive 
"female"  trait.  Addressing  the  notion  of  balance  in  curriculum  and 
instructional  design  would  be  a  complex  task  which  would  require  the 
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designer/developer  to  be  concerned  about  a  much  wider  range  of  variables 
than  have  been  considered  traditionally. 

A  third  approach  to  curriculum  and  instructional  design  might  be  to 
attempt  to  devdop  gender  neutral  lessons  for  all  people.  Such  an  effort  is 
probably  doomed  for  many  reasons  including  "traditional"  expectations  for 
schooling,  the  artificiality  of  pretending  that  gender  docs  not  apply,  and  the 
boring  nature  of  most  anythmg  that  is  homogenized. 
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The  roots  of  rationalism  in  educational  technology  have  been  found  in 
Greek  philosophy,  in  the  development  of  science,  and  in  general  technology 
(Saettler,  1968;  Nichols,  1987)-  Today,  we  find  rationalism  in  our  belief, 
for  instance,  in  the  "Development  of  rationally  sound  instructional 
procedures"  (Gagne\  1987,  p.  5).  What  follows  contrasts  t?ie  rationalism 
of  educational  technology  with  a  version  of  Existential  philosophy  in  order 
to  see  wb?.t  dangers,  moral  implications,  and  alternatives  might  emerge. 

The  Dangers 

The  dangers  of  the  rationalism  of  educational  technology  can  be  seen 
in  at  least  three  areas  (Nichols,  1987).  Physically,  production  of  the 
hardware  we  buy,  for  instance,  uses  up  the  earth's  resources,  creates  toxic 
by-products,  and  threatens  the  earth  and  human  life.  Socially,  educational 
technology  is  threatening  because  it  encourages  poverty  and  social 
dislocation.  Psychologically,  our  technology  encourages  disintegration  of 
the  self. 

By  "psychologically,"  I  mean  the  self  beyond  the  merely  rational. 
Existential  philosophy  has  come  close  to  describing  the  self  I  mean, 
especially  in  that  it  has  been  the  question  of  "a  truth  for  man  tiiat  is  more 
than  a  truth  of  the  intellect"  (Barrett,  1958,  p.  249).  In  Death  of  the  Soul, 
Barrett  (1986)  characterizes  the  self  as  a  passionate,  persistent,  fully 
conscious,  moral  identity  and  not  simply,  as  described  by  some  forms  of 
rationalism,  "someinurt  mental  stuff  or  amalgam  of  perceptions"  (p.  123). 

Of  the  dangers  of  such  rationalism,  he  says,  "The  specialization  of  the 
modem  mind  is  in  the  interests  of  efficiency:  but  this  pursuit  of  efficiency 
can  lead  to  compartmentalization  of  mind  and  the  consequent  fragmentation 
of  the  human  person"  (p.  111). 

In  the  foregoing  sense,  technological  equity  is  a  question  of  equality, 
or  wholeness,  of  the  self  rather  than  a  question  of  equal  access. 

It*s  Dangerous^  But  Is  It  Wrong? 

To  propose  that  the  rationalism  of  educational  technology  is  dangerous 
is  one  thing,  but  to  say  it  is  wrong  is  something  else.  I  want  to  contend, 
however,  that  a  predominant  rationalism  is  wrong  in  its  danger  and  that 
there  exists  a  moral  principle  against  which  we  might  make  judgments  about 
our  educational  technology. 

A  version  of  Existentialism  may  help  to  identify  that  principle.  Most 
Existentialists  believe  that  human  being  is  the  whole  of  individual  existence, 
including  the  irrational  as  well  as  the  rational.  Barrett  (1978)  would  call  this 
the  whole  of  consciousness  and  says,  'V  ^  'ousness  as  the  performer  of 
intentional  [rational]  acts  is  thus  intellig^^iv    ly  on  the  basis  of  our  being  in 
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the  world  It  would  be  without  roots  or  sense  otherwise"  (p.  145)*  The 
attempt  to  understand  the  whole  of  existence  is  a  helpful  rebuke  to  the 
danger  of  self  disintegration.  In  all  its  dealings  with  death  and  nothingness, 
Existentialism  also  can  help  us  to  accept  that  discrete  aspects  of  existence  arc 
not  perfect;  technological  manifestaticMis  of  our  rationality  have  the  power  to 
destroy  existence*  Further,  we  must  let  existence  reveal  itself  (Heidegger, 
1977)  in  order  to  make  progress  toward  an  authentic  self.  A  prevalent, 
controlling  rationalism  will  only  bring  greater  dangen 

However,  much  Existentialism  has  had  problems.  (See  Barrett, 
1958.)  It  has  focused  on  the  individual  and,  so,  is  not  anchored  in  the 
concrete  existence  of  community,  earth,  or  faith*  Facing  the  great 
notfiingness  without  community  or  faith  may  have  caused  the  psychotic 
disintegration  that  overcame  Nietzche*  Also,  it  hasn't  been  ^ble  to  reconcile 
the  rational  with  the  irrational.  Sartre,  for  instance,  turns  out  to  be  a 
Cartesian  rationalist  who  avoids  truth  beyond  the  intellect  by  developing  his 
"will  to  action,"  a  controlling  behavior.  Perhaps  most  seriously,  an 
Existentialist  statement  of  morality  has  bee.,  difficult  to  conceive  (A  notable 
exception  is  Barrett,  1986.)  and/or  has  not  been  widely  disseminated  or 
accepted.  For  instance,  Heidegger  never  wrote  an  ethics,  when  to  reach  the 
ethical  would  require  a  leap  into  "another  region  of  existence"  (Barrett, 
1978,  p.  252)  beyond  the  rational. 

In  contrast,  I  don't  see  existence  as  a  primarily  individual  experience. 
It's  communal  in  that  humans  and  non-human  entities  share  space  and  affect 
one  another.  Further,  humans  share  existence  that  is  both  innate  and 
learned.  For  instance,  sharing  is  found  in  that  as  babies  we  all  try  to  eat  to 
survive  (innate),  and  as  parents  most  of  us  oblige  babies'  attempts  to 
survive  (learned). 

Reconciling  the  rational  with  the  irrational  is  more  difficult.  How,  for 
example,  do  I  express  my  fully  conscious,  tacit,  intuitive  feelings  or 
kr  owledge  in  a  predominantly  technical  world-in  writing,  for  instance? 
Giice  we  have  a  predominant  rational  consciousness,  how  do  we  get  beyond 


This  is  a  profoundly  difficult  problem  for  which  I  will  only  suggest 
here  that  one  path  of  reconciliation  is  by  way  of  seeing  educational 
technology  as  a  moral  question,  and  by  this  path  we  might  begin  to  move 
beyond  a  difficulty  of  most  Existentialism-stating  and  sustaining  an  ethical 
position. 

The  position  outlined  above  offers  an  explanation  of  existence,  but  in 
order  to  begin  judging  our  technology  against  it,  we  must  go  a  step  farther 
and  say  what  is  good  about  about  this  existence.  Most  Existentialists  would 
say  that  existence  or  being  just  is.  No  judgments  are  levied.  However,  I 
propose  the  quite  simple  principle  that  Existence  Is  Good.  That  is,  the 
whole  of  existence  iis  moral,  including  the  rational  and  irrational,  the  life  and 
death,  the  human  and  non-human,  the  individual  and  the  communal,  the 
controlling  and  the  letting  go. 
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Now  the  phrase  "the  whole  of  existence"  and  the  pairs  of  terms  that 
characterize  it  arc  meant  to  signify  a  balance*  or  to  repeat  an  earlier  phrase,  a 
"peaceful  coexistence*"  And  as  long  as  these  aspects  of  existence  are 
allowed  to  be  in  balance  with  one  another,  existence  is  good,  there  is  a 
moral  condition*  Conversely,  let  any  of  the  discrete  aspects  predominate 
and  therc  is  imnx)rality* 

Some  of  our  educational  technology  is  in  opposition  to  the  balance  of 
existence  as  IVe  characterized  it  Thiough  educational  technology  we 
impose  and  seek  a  prcdominandy  rational  view  of  learning  and  instruction. 
We  strive  for  perfection,  while  our  technology  is  only  a  discrete  part  of 
existence  and  cannot  be  perfect.  We  seek  controlling  rather  than  passive 
letting  go.  On  at  least  these  counts,  then^  our  technology  encourages  an 
imbalance  in  existence.  To  this  degree,  our  educational  technology  is  not 
good. 

In  sum,  in  that  they  threaten  us  physically  and  socially,  and  so  stop  or 
impede  existence,  some  forms  of  educational  technology  are,  at  best, 
morally  suspect  To  the  ex*-^t  that  they  seek  a  fully  rational  existence  rather 
than  a  fiiU  existence,  they  may  be  morally  Indefensible. 

Recommendations 

Among  the  many  suggestions  that  could  be  made  if  these  conclusions 
have  merit,  I  will  make  just  two. 

First,  educational  technology  ought  to  be  examined  as  a  moral  issue. 
Second,  a  statement  of  ethics,  perhaps  reflecting  the  position  I  have  taken 
here,  probably  is  needed.  Producing  such  a  statement  runs  the  risk  of 
reducing  morals  and  ethics  to  a  mere  technicality.  However,  if  it  can  be 
used  more  as  guidance  than  as  law,  such  a  statement  might  be  worthwhile. 
In  that  spuit,  here  arc  .some  possible  guidelines  for  educational  technology. 

1.  Seek  to  understand  the  full  implications-negative,  positive  and 
otherwise-of  educational  technology. 

2.  Seek  less  to  control  learning  than  to  allow  it.  This  applies 
especially  to  instructional  design,  where  students  should  have  a  say  in  this 
decision-making  process. 

3.  Seek  learning  in  all  its  aspects.  We  should  look  for  and  allow  the 
mental,  physical,  and,  shall  we  say,  spiritual  aspects  of  humans. 

Conclusion 

To  conclude  that  educational  technology  may  be  morally  indefensible 
is  not  to  say  that  it  is  totally  immoral,  for  that  would  be  to  claim  that  humans 
arc  always  immoral.  We  have  not  completely  lost  our  se!f,  though  the  likes 
of  human  chemical  and  genetic  engineering  may  lead  us  to  full  control  and, 
perhaps,  to  the  "death  of  the  soul." 
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Educational  technology  is  a  moral  issue,  and  I  see  evidence  that  others 
view  it  that  way  and  are  attempting  to  act  accordingly.  There  are,  for 
instance,  symposia  about  the  ethical  nature  of  educational  technology.  And 
I  believe  these  efforts  come  about  through  corj^xience  and  because  existence 
is  good.  As  a  kind  of  evidence,  I  would  ask  if  my  claim  that  a 
prcdominandy  rational-technical  existence  is  dangerous  has  piqued  your 
conscience. 
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This  paper  briefly  explores  four  concepts  that  are  beginning  to  receive 
sustained  discussion  by  groups  in  a  number  of  places,  including  the  instructional 
design  and  technology  prograim  at  our  insti^^  These  four  notions  are:  the  value 
status  of  technolo^,  the  proUferatioa  of  worldviews,  equity  in  education,  and  the 
relationship  of  ethical  issues  to  practice.  These  four  notions  aij  interrelated  and 
coilectively  raise  questions,  we  will  suggest,  that  speak  to  the  future  uses  of  the 
products  of  instructional  technology  in  public  education.  At  the  end  of  the  paper, 
v/e  will  attempt  to  raise  a  few  of  those  questions. 

No  claim  is  made  here  that  these  four  points  are  somehow  definitive  in 
capturing  all  the  forces  that  impinge  upon  an  evolving  instructional  technology. 
They  simply  seem  useful  to  us  in  discussing  issues  that  we  think  important  to  the 
future  of  this  field. 

It  has  been  commonly  understood  that  instructional  technology  is  a  value- 
neutral  method  of  conveying  instructional  information.  We  will  want  to  challenge 
that  assumption  by  showing  throughout  this  paper  how  instructional  technology  is 
value  intensive  in  its  support  of  a  particular  worldview,  what  we  will  call  the 
scientific  worldview. 

When  we  use  the  term  instructional  technology  in  this  paper  we  will  have  in 
mind  the  definition  of  that  term  as  provided  by  Hemich  in  his  1984  ECTJ  paper, 
"The  Pi'oper  Study  of  Instructional  Technology."  Heinich  is  concerned  with 
studying  instructional  technology  in  a  way  that  maJce  clear  its  technological  origins. 
He  offers  definitions  of  general  technology  then  explores  how  these  definitions 
might  help  guide  die  developtzient  of  instructional  technology.  While  drawmg  on 
the  definitions  of  general  technology  offered  by  John  Kenneth  Galbraith  and  Daniel 
Bell,  Heinich  moves  beyond  these  to  provide  a  definition  of  general  technology  that 
he  finds  isomorphic  with  his  vision  of  instructional  technology.  Heinich*s 
definition  emphasizes  the  elements  of  replicabillty,  reUability,  communication  and 
control  among  others  (Heinich,  1984). 

Wc  are  using  Heinich*s  definition  because  ww  agree  that  a  study  of  the 
larger  notion  of  technology  adds  clarity  to  our  understanding  of  instructional 
technology.  His  definition  also  serves  to  bring  into  sharp  relief  the  counter  issues 
we  seek  to  raise  in  this  paper. 

Within  the  scientific  worldview  the  assumption  seems  to  be  that  systematic 
processes,  scientific  methods  and  scientific  knowledge  were  not  arrived  at  through 
poUtical,  economic  and  cultural  decisions.  Even  if  they  were,  the  discussion  is  now 
over.  Today,  we  have  a  idiab'e,  authoritative  and  stable  store  of  knowledge  that 
can  be  passed  on  to  the  ne.. ,  generation.  Earlier,  we  mentioned  that  these 
as/-'\mptions  are  beginning  to  attract  sustained  debate  among  a  number  of  groups. 
Thjse  groups  do  not  necessarily  repudiate  the  practice  and  the  tenets  of  science, 
general  technology  or  instructional  technology;  rather,  their  objection  appears  to  be 
that  such  entities  do  not  rftpresent  their  worldview  and  attendant  knowledge. 


76 

84 


Taylor  &  Swartz,  Symposium— Technological  Equity:  Issues  in  Ethics  &  Theory  24 


Science,  technology  and  instructional  technology,  as  traditionally 
conceived,  have  influenced  the  way  we  view  many  ethical  issues.  One  such  ethici 
issue,  important  in  the  1980s,  has  been  the  national  debate  carried  on  in  the  various 
educational  reform  documents  over  the  subject  of  educational  equity  vs.  educational 
excellence.  Equity  in  education  may  be  understood  as  extending  the  available 
educational  resources  to  all  people  in  the  name  of  "justice,  fairness  or  even  mercy" 
(Smith  and  Traver,  1984).  Instructional  technology  seems  to  be  a  good  choice  to 
distribute  educational  resources  because  it  uses  replicable,  well  documented, 
reliable  techniques  to  conmiunicate  information.  For  example,  an  instructional 
technology  product  that  involves  mathematics"  instruction  for  girls  is  a  public 
document  that  can  be  inspected  for  potential  biases  and  general  appropriateness. 
This  is  seen  as  an  advantage  over  a  live  teacher  whose  instruction  may  not  be 
available  for  perusal.  Also,  special,  provisions  can  be  made  for  hancUcapped 
students  to  assist  them  in  gaining  access  to  educational  resources  via  instructional 
technology.  On  the  other  hand,  instructional  technology  nday  be  assumed  to  be 
equally  effective  while  serving  the  opposing  position  of  excellence  in  education. 
Excellence,  in  contrast  to  equity,  seeks  a  higher  degree  of  human  p^ection  and 
emphasizes  higher  individual  achievement  as  Ae  goal  of  reform  in  American 
education*  The  excellence  movement  "assumes  that  the  only  way  to  produce  a  good 
person  or  a  good  society  is  to  have  high  expectations  and  to  lcleuiand  that  Aese 
expectations  be  met  tiirough  independent,  individual  effort"  (Smith  and  Traver, 
1984). 

Equity  seems  to  emphasize  maximum  acc^^s  to  educational  resources  for 
everyone  while  excellence  seems  to  emphasize  increased  access  to  educational 
resources  for  those  who.excel.  Here  we  have  an  example  of  . how  instructional 
technology  becomes  perceived  as  a  vdue-nentral  vehicle  for  the  delivery  of  all 
knov/ledge.  Within  the  scientific  worldview,  quity  and  excellence  seem  to  be 
major  opposing  positions  which  can  be  served  impartially  via  instructional 
technology  when,  in  our  view,  these  issues  are  primarily  disagreements  about  how 
to  distribute  agreed  upon,  static  information.  That  is,  equity  and  excellence  are  part 
of  a  worldview  that  includes  the  notion  that  the  estabiished^scientific  knowledge 
base  can  be  subdivided  and  redirected  toward  a  pre-selected  audience.  This 
worldview  does  not  assume  a  challengeable,  fluid  kncwi^g^  that  requires  constant 
review  by  differe*;"*  jcial  groups  with  varying  views  as  tc  what  knowledge  is 
pertinent  to  their  ^  ^rid 

We  want  to  provide  here  a  brief  sketch  of  one  of  :he  many  ways  the 
scientific  worldview  is  being  undermined  today.  It  will  hardly  come  as  a  surprise 
to  people  in  this  room  when  we  note  that  something  major  has  happened  to  the 
underpinnings  of  the  ?iuman  sciences  during  the  past  decade.  Scientifically 
generated  knowledge,  once  assumed  to  be  unequivocal  and  atemporal,  but  open  to 
accretionary  growth  like  the  Great  Barrier  Reef,  has  come  under  increasing  attack. 
Tlie  presumed  epistemologically  privileged  position  of  knowledge  that  results  horn 
rigorous  application  of  the  scientific  method  has  been  deeply-some  would  say, 
mortally-chaUenged  Clifford  Geertz  (1983)  dramatically  sums  up  the  situation  by 
saying,  .  .  agreement  on  the  foundations  of  scholarly  authority  ...  has 
disappeared"  (p.  161).  Extending  this  notion  to  professional  practice,  including 
theory  and  practice  in  our  field,  Donald  Schon  calls  attention  to  "the  crisis  in 
confidence  in  professional  knowledge"  (Greene,  p.  69). 

This  climate  of  crisis  created  by  the  challenge  to  a  j^-isitive  science 
worldview  is  allowing  group|  who  hold  alternative  worldviews  about  the 
pro<Juction  and  justification  of  loiowledge,  to  take  a  greater  fortimghtness  in  the 
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assertion  of  their  positions*  Groups  such  as  the  religious  fundamentalists,  blacks 
and  people  of  color,  and  women's  groups  are,  with  growing  confidence, 
demanding  a  fair  hearing  for  their  knowledge  claims  at  the  public  policy '  ^vel  and  in 
the  curriculum  and  instructional  programs  of  ihe  public  schools*  We  think  these 
demands  will  grow  and  eventually  translate  into  a  significandy  altered  common 
education  for  public  school  students* 

While  these  groups  struggle  to  occupy  a  space  left  open  by  a  retreating 
scientific  worldview,  it  is  not  the  knov/ledge  claims,  per  se,  of  these  groups  that 
challenges  science  nor  opens  the  space  for  the  advancement  of  their  claims*  For 
this  is  the  project  of  yet  another  group  that  will  concern  us  here*  The  term  "group" 
is  perhaps  granting  too  great  a  measure  of  coherence  for  what  really  amounts  to  a 
broad  movement  with  disparate  and  even  contradictory  elements*  Currently,  there 
is  no  label  that  adequately  characterizes  the  range  of  work  under  way*  Quentin 
Skinner  (1985)  in  The  Return  of  Grand  Theory  in  the  HumanJSciences,  speaks  of 
the  "invading  hordes"  of  "hermeneuticists,  structuralists,  post-empiricists, 
deconstructionists,  and  other(s)  *  •  *"  0?.  6)*  A  subset  of  the  invading  hordes  that 
intrigues  us  most  goes  under  the  rubric  of  "new  pragmatism"  or  "social 
construction*"  We  will  use  the  terms  interchangeably,  althou^  we  admit  to  a 
growing  preference  for  the  term  new  pragmrtism  because  it  reminds  us  that 
elements  of  this  position  have  been  around  since  the  beginriing  of  the  twentieth 
century*  Richard  Rort:r  more  than  anyone  else,  has  carefully  articulated  the 
arguments  of  the  new  pragmatism;  therefore,  oin:  discussion,  in  this  section,  will 
take  up  liis^majOT  ideas* 

As  a  preface  to  a  discussion  of  Rorty's  new  pragmatism,  we  think  it  prudent 
to  provide  a  framework  for  understanding  his  ideas*  Chieap;><pachis  tobcgin  w^h 
the  work  of  Thomas  Kuhn*  In  his  book.  The  Structure  of  Scientific  RevoluAons 
(1970)  Kuhn  lays  out  a  theory  of  change  in  scientific  knowledge  that  has  been 
widely  discussed*  Change  in  science  occurs  in  a  revolutionary  rather  than  an 
evolutionary  way*  Scientific  knowledge  does  not  gradually  grow  into  ever  larger 
structtires*  Rather,  carrent  structures  or  paradigms  are  replaced  by  newer 
paradigms  that  answer  a  broader  set  of  questioi*3  or  interests*  This  revolutionary 
process  resolves  extant  aiiomalies  between  competing  paradigms*  This  is  the 
familiar  part  of  Kuhn's  thesis*  Less  familiar  is  Kuhn's  conception  of  the  nature  of 
scientific  knowledge  that  undergirds  paradigmatic  change*  "Kuhn's  understanding 
of  scientific  kiiowledge  assumes  that  knowledge  is,  as  he  puts  it  on  the  last  page  of 
his  book,  Intrinsically  the  common  property  of  a  group  or  else  nothing  at  all"* 
(Bruffee,  1986  p*  774;*  In  Lauden's  (1977)  review  of  Kuhn's  conclusions  about 
scientific  decision  making  and  uie  corpus  of  knowledge  flowing  from  such 
decisions,  he  notes  that  die  process  for  Kuhn  "*  *  ^s  basically  a  political  and 
propagandistic  affair,  in  which  prestige,  '  ^  ver,  and  polemics  decisively 
determine  the  outcome  of  the  struggle  between  competing  theories  and  theorists" 
(p*  4)*  Kenneth  BrufTec  writes  tfiis  about  Kuhn's  position: 

For  most  of  us,  the  most  seriously  challenging  aspect  of  Kuhn's  work  is  its 
social  constructionist  epistemological  assumptions*  A  social  constructionist 
position  in  iny  discipline  assumes  that  entities  we  normally  call  reality, 
knowledge,  thought,  facts,  texts,  selves,  and  so  on  ^xt  constructs  generated  by 
communi'.es  of  like-minded  peers*  Social  construciion  understaiJs  reality, 
knowledge,  thought,  facts,  tex^,  selves,  and  so  on  as  cpmmunity-gen^ted  and 
/community-mabtaine')  linguistic  entities-or,  iriire  broadly  speaking,  symbolic 
entities-that  define  or  "constitute"  the  communities  that  generate  them,  much  as 
the  language  of  the  Imted  States  Constitution,  th6  Declaration  oflndepena-  ice, 
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and  the  **Gettysburg  Address**  in  part  constitutes  the  political,  the  legal,  and  to 
some  extent  the  cultural  community  of  Americans  (p.  TJA). 

For  Kuhn,  scientific  knowledge  is  a  social  construct  For  Richard  Rorty, 
all  knowledge  is  a  social  construct  Rorty  . .  assumes  that  there  is  no  such  thing 
as  a  universal  foundation,  ground,  framework,  or  structure  of  knowledge*  There  is 
only  an  agreement,  a  consensus  arrived  at  for  the  time  being  by  communities  of 
knowledgeable  peers*  Concepts,  ideas,  theories,  the  world,  reality,  and  facts  are  all 
language  constructs  generated  by  knowledge  communities  and  used  by  them  to 
maintain  community  coherence"  (Bruffee,  1986,  p*  177)* 

At  least  four  ideas  important  to  our  discussion  can  be  found  above* 
Knowledge,  for  Rorty,  is  socially  justified  belief.  Knowledge  does  not  ground  in 
universal  principles*  Truth  is  made,  not  discovered,  and  since  truth  is  arrived  at 
"only  for  the  time  being,"  truth  is  perishable.  Therefore,  truth  is  made  in  a 
community*  It  is  not  discovered,  that  is,  it  is  not  "out  there"  in  the  world  waiting  to 
be  gradually  uncovered  through  rigorous  scientific  investigation*  According  to 
Rorty,  no  single  epistemology  can  lay  claim  to  immutable  truth  that  a  second 
community  is  obliged  to  accept  (Rorty,  1979)* 

For  Rorty,  truth  and  knowledge  are  no  more  or  less  than  what  someone 
wants  them  to  be*  Knowledge  is  words,  metaphors  offered  by  htmian  wordmakers 
to  describe  how  we  might  live  (Rorty,  1986)*  Rorty  invokes  Nietzsche's  concept 
that  'Truth  is  a  mobile  army  of  metaphors*" 

The  creation  of  worldviews  or  evolutionary  change  within  a  worldview 
results  from  the  metaphors  invented  by  the  "strong  poet"  Strong  poets  created  the 
two  worldviews  thai;  have  dominated  Western  culture  over  the  past  two  millemna, 
namely  the  religi  Jus  worldview  and  the  scientific  worldview.  Rorty  views  religion 
and  science  as  simply  competmg  literatures*  Literatures  created  by  strong  poets  as 
to  how  we  might  obtain  truth  and  use  it  as  a  stanuard  to  live  by  (Rorty,  1987)* 
Religion  and  science  are  exclusionary  literatures:  only  one  way  of  knowing  is  to  be 
sanctioned*  Nonbelievers  of  the  religious  epistemology  of  divine  revelation  are 
considered  "heretics;"  claims  of  knowledge  not  vididated  by  the  epistemology  of 
science  are  dismissed  as  "nonsense*"  Religion  and  science  are  prescriptive  in  terms 
of  values*  Similarly,  technolo^  is  the  embodiment  of  values  that  spring  fi-om  the 
chosen  literature*  Technology,  if  not  value  satuiated,  does  not  exijt  at  all. 

Rorty's  ideas,  which  for  the  sake  of  brevity  we  have  admittedly  simplified, 
we  think  wiU  provide  bases  for  the  formation,  in  the  years  to  come,  of  a  large  and 
powerful  social  group  or  coalition*  Recruits  for  this  group  most  likely  will  be  made 
up  of  defectp!;s  from  the  scientific  camp.  It  seems  probable  they  will  continue  to 
translate  their  ideas  into  an  educational  agenda*  At  a  minimum,  Ac  classroom  will 
become  a  place  where  knowledge  is  created  and  recreated  and  where  received 
knowledge,  stripped  of  its  epistemological  authority,  is  closely  criticized*  To 
paraphrase  an  bid  line  from  Ted  Rozack,  received  knowledge  is  i  )t  for  the  taking, 
but  for  the  debunking* 

Social  change,  even  upheaval,  would  likely  follow  such  a  metamorphosis* 
As  Ira  Shor  and  Paulo  Reire  (1987)  put  it,  "If  teachers  and  students  exercised  the 
power  to  remake  knowledge  in  the  classroom,  then  they  would  be  asserting  their 
pc  vver  t6  remake  society*  The  structure  of  official  knowledge  is  also  the  structure 
of  social  authority"  (p*  10).  Shor  and  Freire  also  foresee  changes  in  the  purpose 
and  methods  of  instruction*  Ctarent  instructional  models,  and  we  might  include 
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standard  instructional  technology  here,  are  viewed  as  being  compatible  with  a  static 
and  passive  curriculum  that  promotes  the  current  dominant  authority  in  society  and 
disempowers  non-dominant  groups. 

*T^ew  pragmatism"  doe?:  not  endorse  any  epistemology,  but  in  its  attack  on 
science  it  creates  a  void  allowing  for  the  empowerment  of  alternative  "knowledge 
communities."  In  terms  of  public  schooling,  for  instance,  religious  fundamentalists 
will  expect  their  divinely  revealed  knowledge  to  be  taken  seriously.  They  will 
assert  that  their  knowledge  allows  access  to  the  fundamental  nature  of  the  meaning 
of  life — the  very  purpose  of  human  existence.  They  claim  their  knowledge  reveals 
hmmn  destiny  beyond  physical  death.  Religious  fundamentalist  knowledge 
purports  to  show  how  to  achieve  contact  with  the  Divine  and  to  derive  tangible 
benefits  from  such  contacts.  If  religious  fundamentalists  are  to  perceive  the  public 
school  curriculum  to  be  representative  of  their  knowledge  community,  then  they 
will  expect  their  knowledge  to  be  woven  into  the  fabric  of  school  knowledge. 

People  of  color  are  also  asserting  their  own  notions  about  how  their 
knowledge  should  be  represented.  Beverly  Gordon  (1987)  foresees  the 
coalescence  of  a  powerful  new  educational  agenda:  "In  the  twenty-first  century,  the 
struggle  will  be  for  the  hearts  and  minds  of  people  of  color  within  Western  societies 
and  the  global  conamunity.  The  critical  battle  will  be  for  control  over  who  educates 
people  of  color  and  over  the  nature  of  that  education"  (p.  442). 

Women's  groups  are  another  instance  of  a  knowledge  community, 
historiCiJly  ignored,  that  is  now  demanding  recognition.  The  form  this  recognition 
will  take,  in  Ae  public  school  classroom,  is  still  evolving.  A  major  struggle  of  the 
past  decade  was  to  establish  a  place  for  women's  work,  both  past  and  present, 
within  the  knowledge  communities  of  the  existing  physical  and  huinan  sciences  arid 
the  humanities.  This  amounts  to  an  adjustment  in  ♦he  literaiy  canoh  of  the  existing 
disciprnes.  More  recendy  there  is  talk  of  parallel  disciplines,  space  that  encourages 
women  to  create  knowledge  that  is  consonant  with  their  deeply-felt  values. 

In  tlie  past  women,  and  people  of  color  have  been  typically  chara'^terized  as 
gender  and  ethnic  groups  rather  tha'^  taiowledge  communities  with  distinct 
worldviews:  This  reflects  their  traditional  lack  of  power.  This  is  likely  t  change. 
Women  and  peofjle  of  color  want  students  representiDg  their  constituencies  to  be 
able  to  make  their  own  knowledge  in  schools  instead  of  Cmply  receiving  and 
digesting  knowledge  supplied  by  th*  dominant  worldview.  They  expect  school  to 
be  a  place  where  knowledge  is  produced  rather.than  merely  reproduced. 

With  these  conye  >ing  claims,  the  classroom  is  likely  to  become  contested 
turf.  Knowledge  from  cbnjfUctingworldvie;wsv/ill^  No  longer 

will  the  knowledge  of  the  scientific  worldview  be  considetied  suifficient  to  animate 
classroom  life* 

We  think  that  the  classroom  interplay  of  competing  worldviews  will  be 
characterized  in  ethical  terms.  Ivlajor  ethical  issues  seldom  arise  when  a  single 
monolithic  world  view  holds  way  over  what  counts  as  legitimate' laiowledge. 
Ethical  issues  within  a  single  worldview  tend  to  be  relatively  trivial  since  they 
involve  matters  of  style  or  interpretations  of  the  canon.  Ethical  questions  are  more 
likely  to  becorne  central  wnen  co'  :?eting  worldviews  clash  over  matters  of 
substance  and  practice.  When  adherents  of  one  worldview  t^e  positions  based  on 
perceived  foundational  principles  that  are  idiosyncratic  to  their  worldview,  they  are 
likely  to  view  ari-unethical,  demands  for  change  originating  from  other  worldviews. 
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Overarching  agreement  on  a  theory  of  ethical  error  seems  unlikely  since  c<»isensus 
itself  might  be  viewed  as  unethical* 

From  this  particular  ethical  perepective,  educational  equity  might  be  viewed 
as  something  other  than  a  simple  exercise  in  altruism*  Equity  can  be  offered  by 
members  of  the  dominant  worldview  to  members  of  other  worldviews  it  deems 
inferior  as  a  ploy  to  eliminate  competing  worldviews*  Is  equity  a  device  for 
enforcing  conformity?  This  question  in  a  variety  of  forms  is  often  raised  today  as  a 
basic  element  in  the  revisionist  critique  of  the  Western  Ubaral  tradition. 

Decnnstructionists  would  raise  similar  questions.  Their  work  seeks  to 
demonstrate  that  our  most  cherished  ideas,  ideas  such  as  equity,  or  justice,  or  even 
mercy,  do  not  exist  "out  there"  in  the  universe  in  some  sort  of  ahistorical  limbo 
waiting  to  be  discovered  and  pressed  into  the  service  of  humankind  Ideas,  as 
such,  have  no  existence  apart  from  the  individuals  and  groups  who  propose  them. 
Michel  Foucault  constructs  histories  which  describe  how  such  ideas  come  to  be 
proposed,  how  tiiey  arc  justified  in  a  knowledge  community  and  what  use  is  made 
of  them.  In  Foucault's  dark  formulations,  the  invention  of  such  ideas-or 
knowledge-is  inseparable  from  power.  Knowledge  and  power  arc  mutually 
reinforcing.  Ideas  are  created  to  extend  the  power  of  a  group  already  powerful 
enough  to  judge  and  punish  a  second  group  they  label  as  deficient  or  deviant 
(Foucault,  1982, 1975). 

the  public  school  classroom,  the  question  is  being  raised  as  to  whose 
knowledge  is  to  count  Is  it  possible  that  at  some  future  time  knowledge  from  all 
knowledge  cocnmunities  or  worldviews  can  be  equally  honored?  How  would  the 
difficult  ethical  issues  be  negotiated?  How  can  we  hope  to  even  hold  open  the 
cciversation?  As  Richard  Bernstein  (1983)  obsen/es  when  writing  about  die  woric 
of  Rorty:  "We  must  appreciate  the  extent  to  which  our  sense  of  community  is 
threatened  ...  by  the  faulty  epistemological  doctrines  that  fill  our  heads.  The 
moral  task  of  the  philosopher  or  cultural  critic  is  to  defend  the  openness  of  human 
conversation  against  all  those  temptations  and  real  threats  that  seek  closure" 
(p.  205). 

If  the  common  school  classroom  is  to  offer  a  space  for  the  "great  human 
conversation,"  where  values,  knowledge  and  action  are  guided  by  ethical 
negotiations  and  where  knowledge  groups  are  equjdly  empowered,  what  might  this 
mean  for  an  evolving  instructional  technology?  Instructional  technology,  as  it  ha* 
been  tiiought  of,>has  supported  die  delivery  of  an  autiioritative  and  relatively  fixed 
knowledge  base  aiSross  time  and  space.  Heinich  holds  that ". . .  the  basic  premise 
of  instructional  technology  is  thtit  all  instructional  contingencies  ran  be  managed 
through  space  and  time, .  ,."  (p.  68).  The  phrase  "through  space  ari^  time"  means 
that  die  same  static  knowledge  is  delivered  to  the  client  group  no  matter  where  they 
reside,  Malibu  g  Harlem,  and,  because  that  knowledge  is  locked  into  a  software 
"time  capsule,"  It  can  be  opened  when  heeded  by  the  client  group,  tomorrovv,  six 
months  or  six  years  from  now. 

Replicability  ,  alluded  to  earlier  in  Heinich*s  definition,  means  sameness: 
the  same  product  once  designed  can  be  reproduced  endlessly  and  used  repeatedly. 
Reliabilit;\  as  used  in  the  deiii  don,  means  the  results  or  outcomes  for  the  groups 
using  the^product  are  the  same  no  matter  where  or  when  they  use  it.  From  an 
instructional  design  point  of  view,  convergent  and  measurable  responses  pegged  to 
carefully  specified  objectives  make  sense  when  attempting  to  transfer  a  pre-selected, 
invariant  body  of  knowledge;  Instructional  designers  use  formative  evaluation 
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procedures  to  vouchsafe  reliability;  that  is,  to  ensure  the  pre-selected  knowledge  is 
reproduced  by  the  leamen 

All  this  has  served  the  field  well.  But  how  well  will  it  ser  the  members  of 
alternative  knowledge  communities  who  expect  their  young  people  to  collectively 
engage  in  the  creation  of  knowledge,  or  people  who  think  knowledge,  like  bread, 
is  best  made  at  the  local  level?  In  the  future,  how  will  instructional  technology 
respond  to  the  requirements  of  fluid,  multiple  knowledge  strcctures  negotiated  at 
the  local  level? 
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One  of  the  fundamental  assumptions  of  instnictional  design  is  that  the 
process  facilitates  fair,  or  equitable,  instruction  for  ail  students.  Needs  assessment 
procedures  are  one  of  the  ways  used  to  insure  instructional  equity.  Theoretically, 
instructional  designers  gather  imormation  from  a  variety  of  sources  at^ut  a  variety 
of  issues,  people,  ar.d  resources,  so  tliat  instruction  can  be  optimized  for  each 
learner.  Mastery  learning  is  another  means  for  insuring  instructional  equity. 
Prerequisite  skills,  knowledge,  and  attitudes  are  assessed  and  used  to  design 
instruction  that  capitalizes  on  individual  capabilities.  Alternative  strategies  are  used 
to  insure  that  each  learner  has  the  "best"  learning  environment.  Criterion 
referenced  evaluation  is  intended  to  provide  fair  assessment;  remediation  and 
enrichment  activities  are  included  to  help  an  individual  student  reach  her  or  his  full 
potential.  In  fact,  the  very  notion  of  "traditional"  classroom  instruction,  that  is, 
teaching  to  the  average  or  middle  ^oup  in  a  class,  is  distasteful  to  instructional 
designers  who  insist  that  each  stucieht  is  an  individual  and  deserves  special  attention 
in  relation  to  his  or  her  capabilities.  The  ethical  way  to  design  and  implement 
equitable  instruction  is  to  use  instructional  design  procedures  and  strategies. 

The  use  of  technological  means  to  increase  individual  potential  is  heralded 
by  some  as  the  crowning  achievement  of  educational  technology.  Computers, 
high-tech  video  equipment,  and  robotic  manipulators  can  be  programmed  to  pro^'^de 
quality  instruction  for  all  minority,  ethnic,  and  special  groups  by  taki  ig  into  account 
individual  and  group  characteristics.  An  individual  learner  can  procecSd  at  liir  or  her 
own  rate,  through  sequences  of  instruction  that  are  specifically  suited  to  individual 
needs,  with  "correct"  amounts  of  feedback  to  increase  motivation,  decrease  anxiety, 
ana  increase  achievement.  Designers  apparendy  have  a  world  of  possibilities  at 
their  fingertips.  Yet,  here  is  a  symposium  that  questions  some  of  the  fundamental 
assumptions  of  the  field.  Perhaps,  the  authors  suggest,  educational  technology 
does  not  provide  or  promote  equitable  instruction  for  all.  Some  of  the  autfiors 
suggest  that  we  might  be  able  ^o  promote  ev7uity  if  we  approached  design 
differently;  that  is,  if  we  asked  cufferent  quesiio  is  during  a  needs  assessment, 
included  different  cognitive  and  affective  knowledge  ana  skills  in  our  instruction  or 
used  different  strategies.  Other  authors,  however,  take  a  more  radical  view  and 
question  whether  or  not  educational  technology  and  equity  are  mutually  exclusive. 
Like  tbo  old  George  Carlin  joke  about  military  intelligence  being  a  contradiction  in 
terms,  tiies6  aut*^  ;rs  wonder  if  educational  technologj'  and  equity  are  an  oxymoron. 

There  are  no  doubt  numbers  of  arguments  that  can  be  made  to  refute  or  to 
support  the  educational  technology  and  equity  question.  However,  since  the 
theoretical  and  philosophical  bases  of  ID  support  equit)r  in  instruction,  the  purpose 
of  this  paper  is  to  present  three  issues  related  to  designing  equitable  instruction. 
The  overriding  question  to  be  addressed  is:  How  much  of  Ae  instructional  process 
shodd  instmctional  designers  control  by  pre-planning  and  managing  instruction  so 
that  it  is  equitable  or  unbiased*  Since  this  is  quite  complex,  three  related  issues  will 
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be  discussed  that  may  help  us  come  to  grips  with  our  responsibilities  as  educators 
regarding  the  design  of  equitable  instruction* 


Toward  More  Equitable  Instructional  Design 

The  issues  raised  in  this  paper  are  value  questions  or  philosophical  issues 
that  have  no  inherent  correctness  or  incorrectness  to  them*  They  are  intends!  to 
promote  discussion.  The  first  issue  addresses  who  is^  responsible  for  student 
learning,  the  designer  who  plans  the  instruction,  or  the  student?  The  second  issue 
addresses  whether  or  not  we  can  now  or  ever  will  be  able  to  manage  the 
contingencies  of  instruction  so  that  we  can  insure  student  learning.  The  third  issue 
focuses  on  student  self-development  and  the  requirement  that  students  should 
assume  some  responsibility  for  their  own  learning.  I  have  omitted  specific  issues 
related  to  knowledge  bases  and  content  that  should  be  included  in  instructional 
objectives  since  Taylor  and  Swartz  (1988)  have  already  addressed  these  issues. 


The  Issue  of  Responsibility 

I  remember  the  first  university  course  I  taught  using  instructional  design 
procedures.  The  course  was  an  ID  course  and  I  was  thoroughly  prepared  (or  so  I 
thought).  I  remember  my  devastation  after  the  midterm  when  about  one-quarter  of 
the  class  did  much  more  poorly  than  I  anticipated.  What  had  I  done  wrong?  What 
did  I  forget  in  designing  this  class?  Were  the  objectives  too  hard?  Did  I  miss  some 
prerequisites?  Were  the  materials  appropriate  for  the  objectives?  Were  the 
examples  representative?  Did  I  fail  to  motivate  the  students?  Using  the  systems 
approach  that  I  had  been  taught,  I  tried  to  figure  out  what  I  had  done  wrong.  I  did 
not  at  the  time  give  serious  attention  to  the  fact  that  perhaps  at  least  some  of  the 
students  who  had  done  poorly  were  to  blame  for  their  own  poor  performance. 
Perhaps  I  had  designed  good  or  even  very  good  instruction,  and  perhaps  I  had  even 
delivered  it  well.  Perhaps  it  was  the  students  who  had  not  taken  responsibility  for 
their  own  learning. 

The  first  issue  I  would  like  to  raise  regarding  equity  revolves  around  the 
issue  of  who  is  primarily  responsible  for  student  learning?  Instructional  design 
theory  highlights  managing  the  contingencies  of  instruction,  that  is,  pre-planning 
and  organizing  the  design  and  delivery  of  instruction.  While  the  learners*  role  can 
be  active  (Romiszowski,  1981),  it  is  by  and  large  the  instructional  designer  or 
teacher  who  plans  and  manages  the  instriction. 

Who  Should  be  Responsible?  I  should  have  been  prepared  for  the 
problem  I  faced  with  that  first  class  because  a  professor  of  mine  who  was  a  strong 
-advocate  of  instructional  design  once  remaiked  that  we  (professors,  students,  and 
the  educational  system  in  general)  were  going  to  pay  a  price  for  assuming  so  much 
responsibility  for  student  learning.  He  hypothesised  that  as  designers  and  teachers 
took  responsibility  for  insuring  student  success  by  assessing  learner  needs,  setting 
objectives,  determining  optimal  instructional  strategies,  using  the  latest  and  "best" 
delivery  systems,  construction  and  using  fair  evaluation  devices,  and  "recycling" 
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students  who  fail  to  reach  mastery,  that  we  left  little  responsibility  for  the  learner. 
He  summed  up  his  thoughts  by  saying  that  student  failures.^  became  our  failures  and 
that  our  failure  was  the  inability  to  control  the  variables  necessary  to  design 
"perfect"  instruction.  At  what  point,  he  asked,  do  we  say  that  the  learner  didn't 
learn  because  of  something  he  or  she  did  or  did  not  do,  ratiier  than  because  of 
something  we  did  not  do? 

While  the  professor's  comments  are  in  some  ways  extreme,  what  he  said 
also  has  some  truth.  Instructional  design  docs  put  instructiond  control  and 
decision-making  in  the  hands  of  the  designer  or  teacher.  If  we  believe  tfiat  we  can 
CO.  trol  t}.\e  variables  and  design  adequate  instruction,  are  we  dso  assuming  that  by 
our  efforts  we  should  also  be  able  to  insure  student  success?  I  believe  so.  Yet 
research  suggests  that  quality  of  instruction  accounts  for  very  little  (nerhaps  5%)  of 
achievement  variance  Martin  &  Briggs,  1986).  Martin  and  Briggs  (1986)  state ". . 
.,  and  by  any  definitioh  of  quality  of  instruction  presently  witfun  our  state  of  the  art, 
we  estimate,  with  chagrin,  that  quality  of  instmction  must  be  ranked  relatively  low 
as  we  have  it  here,  among  the  more  powerful  influences  upon  learning"  (p.  31). 
They  suggest  that  the  more  powerful  influences  on  student  achievement  are  home 
environment,  intelligence,  motivation,  and  self-esteem  to  name  only  a  few. 

Instructional  designers  persist  We  want  to  activate  the  internal  processes  of 
the  learner,  insure  their  attention,  and  motivate  them  by  designing  exciting 
instruction.  Having  done  the  above,  if  a  student  is  not  ruccessful  we  generally 
conclude  that  the  instruction  was  flawed  and  that  we  can  correct  it.  Rarely  do  we 
say  (at  least  publicly)  that  the  student  didn't  try  hard  enough,  or  didn't  spend 
enough  time,  or  didn't  care  enough. 

I  have  intentionally  overstated  this  issue  of  responsibility  because  I  believe  it 
is  one  of  the  key  ethical  issues  that  instructional  designers  have  to  contend  with 
when  dealing  with  issues  of  equity.  Natundly,  instructional  designers  and  teachers 
must  assume  some  responsibility  for  student  succe:is  and  failure.  There  arc  things 
we  know  which  promote  student  learning',  such  as  time  on  task,  and  our  designs 
can  provide  for  adequate  practice  opportunities  with  appropriate  learning  materials. 
However,  there  is  no  ^arantec  that  each  learner  will  succeed  using  these  methods 
and  materials  without  intemai  motivation  and  active  involvement.  TTiere  are  some 
things  that  we  neither  can  be  responsible  for  nor  should  we  be  responsible  for. 
Where  that  balance  lies  between  our  responsibility  and  student  responsibility  is  one 
of  the  important  ethical  decisions  we  will  have  to  face  as  we  address  die  issue  of 
equity. 


The  Issue  of  Managing  the  Contingencies  of  Instruction 

There  is  certainly  nothing  wrong  with  attempting  to  design  instruction  that  is 
motivating  and  that  meets  the  needs  of  each  learner,  but  the  task  we  set  for 
ourselves  in  trying  to  control  every  aspect  of  instruction,  making  it  rcsponsive.to 
each  and  every  students  is  impossible.  It  is  not  impossible  becauseiwe  do  not  try 
hard  enough,  or  because  the  desire  is  not  there,  it  is  impossible  because  there  are 
too  many  variables  with  which  to  contend.  ATI  research  demonstrated  that  years 
ago.  After  years  of  research  and  substantial  reviews  of  the  findings  Cronbach  and 
Snow  (1977)  concluded  tiiat  "no  Aptitude  X  Treatment  Interactions  are  so  well 
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confirmed  that  they  can  be  used  directly  as  guides  to  instruction"  (p*  492)*  In 
addition  to  inconclusive  results  were  a  number  of  other  problems  with  ATI 
research:  inconsistent  results,  results  that  were  not  replicable,  generalizations  that 
were  not  stable  across  popi^lations  groups,  and  even  generalizations  that  were  not 
stable  from  one  decade  to  the  next  (Tobias,  1987)* 

There  are  some  parallels  between  the  ATI  research  and  the  issue  of 
controlling  the  variables  in  instructional  design*  Rciguluth  (1983)  has  spearfieadcd 
a  "nx)vement"  to  dcvelq)  a  prescriptive  theory  of  instructional  design.  It  has  much 
the  same  motivation  as  the  ATI  research,  tiiat  is,  to  detennine  the  optimal  methods 
for  instruction  under  certain  conditions  (learners  and  environment)  for  pre- 
specified,  desired  outcomes.  Given  such  a  prescriptive  theory,  instructional 
designers  and  practitioners  could  develop  instruction  systematically  with  some 
degree  of  certainty  tiiat  prescribed  methods  would  produce  desired  outcomes  for 
particular  groups  of  learners  under  certain  conditions.  The  search,  tiien,  is  for  a 
science  of  instructional  design. 

What  Reigulutii  and  other  researchers  (Cropper,  1983;  Landa,  1983; 
Snelbecker,  1983)  are  attempting  is  noble,  however,  it  may  be  futile.  It  may  be 
tiiat,  like :;  ^e  ATI  research  preceding  it,;  tiiat  there  is  no  systematic  way  la  develop  a 
comprehensive  theory  of  mstructional  design.  This  need  not  be  looked  at  as  a 
failure.  The  problem  may  be  a  practical  (Hie,  tiiat  is,  tiiere  are  too  many  variables  to 
account  for  and  control  and  tiiat  the  amounts  of  variance  tiiat  any  given  variable  can 
account  for  fluctuates  £Dpm  situation  to  situation,  over  time,  witii  diiferrnt  groups. 

Nichols  (1988)  suggests,  however,  that  tiie  issue  of  managing  the 
coiitingencies  of  instruction  may  be  a  moral  one.  Using  an  existential  point  of 
view,  he  questions  tiie  "predominantly  ration  view  of  learning  and  instruction" 
proposed  by  educational  technologistsj  He  characterize^  extreme  rationalism  and 
our  quest  for  controlling  instruction  and  learners  as  morally  indefensible. 

If  it  is  eitiier  a  practical  impossibility  to  aesign  instruction  witii  the  precision 
we  desire  or  if  it  is  morally  indefensible,  what  is  the  etiiical  approach  to  designing 
instruction,  taking  into  account  the  individual  leanier,  special  interest  greups>  and 
etisiiic  and  minori^  groups,  specifically  instruction  that  is  more  responsive  to 
females  (Belland  &  Baker,  1988;  Damarin,  1988)  and  to  disabled  learners  (Howell, 
1988)?  How  much  can  we  promise?  Which  group(s)  should  receive  tiie  lion's 
share  of  our  time  and  rescorces? 

While  tiiere  are  numbers  of  related  etiiical  issues  regarding^xnanaging  and 
controlling  instruction,  tiie  one  I  would  like  to  highlight  is:  Are  w^  promising  too 
much  to  practitioners  and  learners?  Based  on  excellent  research  done  previously, 
i.e.,  the  A  J!  studies;  we  know  that  we  cannot  now  and  may  never  be  able  to  be  as 
precise  in  cuf^ design  as  some  would  like.  The  fact  tiiat  this  is  true  should  not  deter 
us  as  a  field  frcmi  ':ontinuing  to  discover  generalizations  about  optimal  methods  for 
specific  groups  of  learners.  However,  -t  is  unethical  to  promote  the  idea  tiiat  we 
presentiy  have  a  science  of  instnictional  design  that  works"  or  tiiat  we  will  have 
one  in  tiie  near  future. 

There  is,  however,  much  valuable  information  that  we  can  impart  to 
practitioners,  e.g.,  tiie  benefits  of  systems  thinking  and  systems  design,  the 
benefits  of  objectives  and  cnterion  referenced  evaluation,  and  the  benefits  of 
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computers  and  interactive  video  discs.  But  there  are  multiple  points  of  view  about 
the  theoretical  bases  and  practical  ideas  we  support  and  promote.  Part  of  our  job  as 
educators  is  to  stimulate  discussion  rather  than  to  say  we  have  grounded  answers 
and  findings  when  in  fact  wc  do  not  Practitioners  are  capable  of  making  their  own 
decisions.  If  our  ideas  and  theories  are  sound,  they  will  "sell"  themselves. 


The  Issue  of  Learner  Self-deveiopment 

One  implicit  purpose  of  education  is  to  increase  learners*  independence  and 
self-reliance.  We  want  students  who  can  think  for  themselves,  direct  and  be 
responsible  for  their  own  learning,  anu  who  are  self-motivated.  Even  though  3ome 
of  the  papers  presented  here  suggest  that  we  as  instructional  designers  need  to  be 
more  responsive  to  the  needs  of  a  greater  variety  of  leamers  in  the  design  process, 
they  also  say  that  \7t  need  to  promote  and  foster  self-development.  For  example, 
Howell  (1988)  makes  a  plea  for  instructional  designers  to  plan  and  implement 
instruction  that  assists  disabled  leamers  to  become  more  self-sufficient  and 
independent. 

Belland  and  Baker  (1988)  and  Damarin  (1988)  describe  the  need  for 
increasing  the  individual  freedom  of  women.  Although,  Belland  and  Baker  focus 
on  visual-spatial  thinking  as  a  factor  in  limiting  female  development,  their  interest 
appears  to  be  in  providing  full  opportunities  for  all  leamers  whether  male  or  female. 
They  say,  "In  our  system  of  education,  anyone  has  the  right  to  develop  aptitudes 
and  abilities  to  their  full  potential." 

Damarin,  describing  ICAI  and  its  potential  benefits  and  effects  on  women, 
suggests  that  ICAI  include  indices  such  as  difficulty,  anxiety,  and  usefulness 
attached  to  the  mathematical  knowledge  domain  so  that  the  female  leamer  might 
have  greater  control  over  her  own  learning.  Since  research  suggests  tiiat  different 
cultural  groups  and  perhaps  males  and  females  use  ^temate  modes  of  information 
seeking  and  gathering,  the  implication  is  "that  the  organization  of  concepts  in  ICAI 
must  be  fluid  rather  than  fixed,  giving  leamers  the  opportunity  to  structure  their 
own  knowledge  in  a  manner  consistent  with  their  own  linguistic  and  cognitive 
structures." 

Nichols  (1988)  concurs.  He  suggests  that  students  should  have  more  say  in 
the  instructional  design  process.  He  goes  on  to  suggest  that  educational  technology 
may  fail  to  develop  the  whole  essence  of  individuals,  that  we  in  fact 
compartmentalize  individuals.  Rather,  "We  should  look  for  and  allow  the  mental, 
physical,  and,  shall  we  say,  spiritual  aspects  of  humans." 

These  authors  are  calling  for  a  learning  system  and  envkonment  that  fosters 
individual  self-development.  The  goals  are  to  (a)  increase  the  personal 
independence  of  learners,  and  (b)  allow  opportunities  for  choice  and  decision- 
making in  the  instructional  design  process,  while  at  the  same  time  providing  for  (c) 
specialized  educational  interventions  that  reduce  or  eliminate  bias  toward  ethnic, 
minority  or  special  interest  groups  so  that  these  leamers  can  reach  their  full 
potential,  and  (d)  provide  access  to  tools  and  experiences  that  will  increase  the 
quality  of  life  for  all. 
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One  of  the  external  conditions  of  learning  that  promotes  personal 
independence  and  self-development  is  to  provide  opportunities  for  self-directed 
behavior,  for  example,  opportunities  for  learners  to  set  their  own  goals,  evaluate 
their  own  performance,  and  select  and  use  learning  activities  and  strategies  suited  to 
their  learning  styles  and  preferences  (Martin  &  Briggr  1986).  In  order  to  provide 
these  opportunities  instructional  designers  may  have  to  relinquish  some  of  the 
responsibility  and  control  of  the  design  process  and  develop  instruction  that  is  more 
flexible  and  that  is  not  replicable  since  objectives,  activities,  strategies,  and 
evaluation  may  vary  to  fit  learner  needs  from  their  perspective. 

The  issues  related  to  promoting  self-development,  by  providing 
opportunities  for  choice,  are  fairly  obvious.  Questions  arise  such  as: 

1.  How  competent  are  students  to  determine  what  they  should  learn?  Will  they 
omit  important  content  that  is  crucial  for  fully  functioning  in  this  world?  Are 
designers  more  capable  than  students  and  parents  in  determining  which  pre-selected 
body  of  knowledge  to  transfer  (Taylor  &  Swartz,  1988)? 

2.  How  capable  are  special  students,  i.e.,  disabled  learners,  functional  illiterates,  to 
select  appropriate  objectives  and  learning  methods  that  will  increase  their  cognitive 
and  affective  development?  If  designers  provide  a  range  of  options  so  tihat  students 
can  make  choices,  is  that  adequate? 

3.  How  should  we  respond  to  gender  issues?  What  if  educational  interventions 
have  the  opposite  effect  than  intended,  e.g.,  a  more  powerful  effect  on  males 
(Belland  &  Baker,  J  988)?  How  should  we  respond  to  researchers  from  the 
feminist  perspective  who  state  that  knowledge  is  not  value-free  and  may  have 
masculine  connotations?  What  if  students  are  unaware  or  unconcerned  about  these 
issues? 

4.  Should  instruction  first  be  designed  that  teaches  students  how  to  manage  their 
own  learning  as  Derry  (1984)  and  Sternberg  (1983)  have  suggested.  If  yes,  what 
aspects  of  curriculum  should  be  omitted  so  that  this  instruction  can  be  included? 
How  much  influence  should  instructional  designers  exert  in  preparing  such 
instruction. 

There  are  no  easy  answers  to  such  questions.  There  is  no  way  to  know 
how  much  pedagogical  knowledge  to  apply  to  any  learning  situation,  nor  is  there 
any  way  to  kno^  how  many  options  to  give  individual  learners,  or  how  often  to  do 
so.  To  even  attempt  to  define  such  rational  and  logical  procedures  offends  some. 
However,  the  issue  can  be  approached  as  an  ethical  one.  We  have  the 
responribility  as  educators  to  promote  student  self-growth  and  development.  We 
also  ha^'e  a  responsibility  to  extend  and  expand  the  knowledge  base  in  our  field  so 
that  quality  instruction  can  be  designed  that  provides  a  chance  for  all  learners  to 
have  a  full  and  rewarding  life.  How  we  balance  these  two  responsibilities  is  an 
ethical  issue. 


Summary  and  Conclusions 
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At  the  philosq)hic  core  of  instructional  design  is  the  belief  that  each  learner 
is  an  individual  and  that  instruction  can  be  desf^ed  that  capitalizes  on  individual 
strengths.  Therefore,  we  support  and  promote  equity  in  iniitruction.  What  causes 
concem  for  some  in  our  field  is  that  the  knowledge  we  select  and  the  processes  and 
strategies  we  use  may  actually  deter  us  from  our  goal  of  designing  equitible 
instruction.  So,  while  we  maintain  the  belief  that  we  can  and  should  design 
unbiased  and  impartial  instruction  for  all  learners,  the  research  (and  our  practical 
experience)  leads  us  to  question  the  practicality  of  this  assumption.  In  relation  to 
this,  three  issues  were  raised. 

The  first  concerns  who  is  responsible  for  student  success.  Instructional 
designers  have  perhaps  taken  more  responsibility  for  student  success  than  they 
should.  By  trying  to  control  and  manage  the  contingencies  of  instruction  so  that 
each  learner  succeeds,  we  have  taken  responsibility  for  success  away  from  learners. 
We  need  to  think  again  about  who  is  responsible  for  student  learning,  including 
what  the  learner  should  be  responsible  for  and  how  to  promote  responsible 
behavior.  Some  of  the  research  on  social  learning  Aeory  constructs  such  as  self- 
efficacy  (Bandura,  1977)  and  self-regulatory  behavior  (Bandura,  1978),  and  the 
research  on  attributions  (Bar-Tal,  1978;  Weinea:,  1979)  and  learned  helplessness 
(Abramson,  Seligman,  &  Teasdale,  1978)  may  provide  valuable  insights  on  how  to 
proceed  with  this. 

The  second  issue  deals  with  our  ability  to  design  instruction  that  delivers 
what  it  promises.  Instruction  is  a  science  and  an  art.  To  suggest  that  we  have 
developed  a  comprehensive  theory  of  instructional  design  or  that  we  can  is 
misleading.  To  suggest  that  we  can  design  instruction  that  will  meet  the  needs  of 
each  learner  and  that  will  be  unbiased  toward  any  group  is  a  fallacy.  Some  of  what 
we  know  we  can  be  fairly  sure  of;  other  aspects  of  our  theories  are  educated 
guesses;  still  other  aspects  are  mere  shots  in  the  daik.  Although  other  researchers 
and  practitioners  are  capable  of  interpreting  research  for  themselves,  we  also  need 
to  provide  honest  and  clear  interpretations.  We  should  not  promise  what  we  cannot 
deliver. 

The  last  issue  concems  learner  self-development.  In  order  for  learners  to 
become  independent  and  self-directed,  we  need  to  provide  them  with  opportunities 
to  design  aspK5Cts  of  their  own  learning.  To  do  so  means  that  as  designers  will  have 
to  accept  the  faa  that  learners  can  make  some  choices  that  are  better  for  themselves 
than  we  can.  We  will  have  to  give  up  some  of  the  control  we  have  previously  had 
and  turn  it  over  to  learners.  Ethically,  we  are  committed  to  providing  the  best 
learning  experiences  for  aJl  students.  However,  as  we  apply  what  we  know  about 
learning  and  instruction  to  the  design  process  and  take  more  control  of  that  process, 
we  run  the  risk  of  reducing  opportunities  for  students  to  become  decision  makers 
and  participants  in  the  instructional  process.  Theoretically  at  least  we  may  limit 
student  self  development  by  providing  the  "best"  instinction  we  can. 

The  original  question  posed  at  the  beginning  of  this  paper  was:  How  much 
of  the  instructional  process  should  instructional  designers  control  by  pre-planning 
and  managing  instruction  so  that  it  is  equitable?  If  we  agree  that  students  should  be 
at  least  equ^ly  responsible  for  their  own  academic  success  as  we  are  and  that 
promoting  self-development  by  providing  learners  with  opportunities  to  make 
choices  about  their  own  learning  is  important,  then  we  have  to  face  the  fact  that  we 
will  have  to  give  up  some  control  of  the  learning  process.  This,  coupled  with  the 
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fact  that  we  may  not  be  able  to  plan  completely  unbiased  and  equitable  instruction, 
means  that  we  need  to  ask  different  questions*  we  may  need  to  begin  to  search  for 
answers  to  questions  such  as: 

1.  How  do  we  promote  a  learning  environment  that  helps  learners  become 
responsible  for  their  own  success? 

2.  At  what  point  can  we  say  with  some  assurance  that  certain  methods,  activities, 
and  strategies  will  be  successful?  How  much  can  we  promise  fiom  our  research? 

3.  How  do  we  promote  learner  self-development  and  at  the  same  time  make  the 
best  use  of  our  faiowledge  about  designing  and  managing  instruction? 

It  is  doubtful  that  the  answers  to  such  questions  will  come  fiom  research. 
They  will  most  likely  come  from  individuals  and  groups  of  in^viduals  who 
participate  in  symposia  such  as  this,  and  also  from  our  work  with  students, 
schools,  and  businesses.  And  of  course  the  answers  will  come  as  we  continue  to 
critically  review  our  goals  as  educators  and  the  theory  bases  of  our  profession 
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Rationale 

Last  yearns  AECT  Convention  produced  a  significant  number  of 
RTD  Papers  on  the. topic  of  micro-computer  based  instruction 
(MCBI).     In  addition,  other  related  professional  areas  are 
experiencing  similar  interest  in  the  design  of  high  quality  MCBI 
instruction,  for  academic  learning  as  well  as  skill  development 
in  industrial  and  business  training.    For  example,  a  recent 
special  issue  of  Engineering  Education  Journal  (1986)  was 
dedicated  to  the  design  of  MCBI  for  science  and  engineering 
curricultams.    The  1987  American  Society  for  Engineering  Education 
Annual  Conference  had  a  significant  number  of  research  papers  on 
the  design  and  application  of  MCBI  for  improving  instruction  in 
science  and  engineering  (1987).    A  recent  article  by  Wise  (1986) 
indicated  a  similar  interest  in  MCBI  applications  for  business 
training,  finding  MCBI  to  be  effective  for  learning  and  also  cost 
effective  (also,  Carney  1987).    Additional  interest  with  MCBI 
can  be  found  at  ASTD  Annual  Meetings,  as  well  as  other 
specialized  education  meetings,  such  as  The  National  Science 
Teachers  Association  Conference  (1987).    However  while  a 
significant  level  of  interest  exists  for  MCBI  instruction,  and 
research  and  development  with  MCBI  continues,  few  of  these 
presentations  and  studies  have  considered  cognitive  style 
variables.    Cognitive  style  variables  can  have  a  significant 
impact  upon  the  perception  and  learning  of  academic  information 
(Cross,  1976).    Additionally,  the  micro-computer  seems  to  be  the 
only  technology  allowing  for  a  true  systematic  examination  of 
cognitive  style  by  instructional  design  relationships  (Gagne, 
1983).    While  early  attempts  at  such  trait-by-treatment 
interactions  research  proved  less  than  favorable  (Hunt,  1973), 
such  learning  style  issues  can  now  be  examined  within  the  context 
of  real  academic  instructional  situations^  to  observe  the 
perceptual  and  learning  differences  caused  by  cognitive  styles. 

The  present  study  examines  two  cognitive  style  variables,  in 
three  separate  experimental  designs.    This  study  is  a  preliminary 
study,  to  evaluate  cognitive  styles,  and  instructional  and 
testing  conditions.    A  later  study  is  planned  implementing  these 
evaluated  instructional  and  testing  materials  into  MCBI 
conditions,  and  further  examining  cognitive  style  effects  on 
perception  and  learning. 

Cognitive  Styles 

While  much  has  been  written  about  cognitive  styles,  there 
seems  to  be  a  good  bit  of  misconception  about  what  cognitive 
styles  actually  are,  and  what  effect  specific  cognitive  styles 
have  upon  learning  and  perception.    Surprisingly,  educators  are 
now  in  a  position  to  examine  these  individual  difference  types, 
with  the  use  of  MCBI,  but  few  new  trait-by-treatment  studies  have 
been  completed. 


97 
104 


3 


Cognitive  style  was  originally  defined  as  a  perceptual 
characteristic  caused  by  the  interaction  of  genetic  factors  and 
environmental  factors  as  the  individual  develops  or  simply 
stated,  perceptual  behavior  is  a  function  of  the  person  and 
environment,  [B,  P(PrE)],  (Lewin,  1935?  Cronbach,  1967;  Hunt, 
1973).    Cognitive  style  can  then  be  operationally  defined  as  the 
differences  in  perception  individuals  have  of  information  in  the 
environment,  based  upon  their  background.    In  other  words,  the 
same  perceptual  situation  may  be  viewed  differently  by  two 
individuals,  contingent  upon  their  cognitive  styles.  For 
example,  a  high  dogmatic  individual  may  perceive  a  political 
candidate  much  differently  than  a  low  dogmatic  individual  views 
the  same  political  candidate.    Similarly,  the  low  dogmatic 
cognitive  style  will  actually  ••see"  different  things,  usually 
more  information,  in  the  same  situation  as  experienced  by  the 
high  dogmatic  cognitive  style.    While  the  cognitive  style  issue 
has  implications  for  personality  research  and  perception  (i.e. 
the  vast  number  of  studies  done  on  Dogmatism),  such  perceptual 
factors  will  impact  upon  learning  (Witkin,  1873): 

••Cognitive  style  is  a  potent  variable  in  students' 
academic  choices  and  vocational  preferences;  in 
students'  academic  development  through  their  school 
career;  in  how  students  learn  and  teachers  teach; 
and  in  how  students  and  teachers  interact  in  the 
classroom.  ••  (p.l.) 

However,  while  a  good  deal  is  known  about  the  topic  of  cognitive 
styles,  little  of  this  knowledge  has  been  used  by  educators,  for 
example  (Cross,  1976) : 

••Unfortunately,  not  one  teacher  or  counselor  in 
a  hundred  knows  anything  at  all  about  cognitive 
styles  despite  the  fact  that  research  on  cognitive 
styles  has  been  going  on  for  some  twenty-five  years 
in  psychological  laboratories.  •• 

As  Kogan  noted  sometime  ago  (1971),  this  type  of  situation  is 
caused  by  a  total  lack  of  articulation  between  psychological 
study  of  cognition  and  those  conducting  and  reporting  educational 
research,  and  those  in  the  practice  of  education  and  teaching. 
This  situation  should  be  remedied  by  those  researchers  involved 
in  applied  educational  research.    A  variety  of  cognitive  styles 
have  now  been  identified,  and  most  of  these  researched  to  varying 
degrees.    Currently  about  12-18  different  cognitive  styles  have 
been  investigated.    Here  is  a  definition  of  9  of  these  cognitive 
styles  developed  by  Messick  (1970): 

1.  Field  independence  versus  field 
dependence  -  ••an  analytical,  in  contrast  to  a 
global,  way  of  perceiving  [which]  entails  a 
tendency  to  experience  items  as  discrete  from 
their  backgrounds  and  reflects  ability  to 
overcome  the  influence  of  an  embedding  context.  •• 
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2.  Scanning  -  ••a  dimension  of  individual 
differences  in  the  extensiveness  and  intensity  of 
attention  deployment,  leading  to  individual 
variations  in  vividness  of  experience  and  the 
span  of  awareness. 

3.  Breadth  of  categorizing  -  ••consistent 
preferences  for  broad  inclusiveness,  as  opposed 
to  narrow  exclusiveness,  in  establishing  the 
acceptable  range  for  specified  categories.  •• 

4.  Conceptualizing  styles  -  ••individual 
differences  in  the  tendency  to  categorize 
perceived  similarities  and  differences  among 
stimuli  in  terms  of  many  differentiated  concepts, 
which  is  a  dimension  called  conceptual 
differentiation  as  well  as  consistencies  in  the 
utilization  of  particular  conceptualizing 
approaches  as  bases  for  forming  concepts-such  as 
the  routine  use  in  concept  formation  of  thematic 
or  functional  relations  among  stimuli  as  opposed 
to  the  analysis  of  descriptive  attributes  or  the 
inference  of  class  membership.  •• 

5.  Cognitive  complexity  versus  simplicity  - 
••individual  differences  in  the  tendency  to 
construct  the  world,  and  particularly  the  world 
of  social  behavior,  in  a  multidimensional  and 
discriminaling  way.^^ 

6.  Reflectiveness  versus  impulsivity  - 
••individual  consistencies  in  the  speed  with  which 
hypotheses  are  selected  and  infoL^mation 
processed,  with  impulsive  subjects  tending  to 
offer  the  first  answer  that  occurs  to  them,  even 
though  it  is  frequently  incorrect,  and  reflective 
subjects  tending  tc  ponder  various  possibilities 
before  deciding.  •• 

7.  Leveling  versus  sharpening  -  ••reliable 
individual  variations  in  assimilation  in  memory. 
Subjects  at  the  leveling  extreme  tend  to  blur 
similar  memories  and  to  merge  perceived  objects 
or  events  with  similar  but  not  identical  events 
recalled  from  previous  experience.  Sharpeners, 
at  the  other  extreme,  are  less  prone  to  confuse 
similar  objects  and,  by  contrast,  may  even  judge 
the  present  to  be  less  similar  to  the  past  than 
is  actually  the  case.^^ 

8.  Constricted  versus  flexible  control  - 
••individual  differences  in  susceptibility  to 
distraction  and  cognitive  interferences  in 
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susceptibility  to  distraction  and  cognitive 
interference. 

9.  Tolerance  for  incongruous  or  unrealistic 
experiences  -  ••a  dimension  of  differential 
willingness  to  accept  perceptions  at  variance 
with  conventional  experience."  (pp.  188-189) 

The  systematic  evaluation  of  cognitive  styles ^  and  how  to 
design  effective  learning  conditions  for  each  specific  cognitive 
style ^  should  be  further  examined.    However ^  while  early 
trait-by-treatment  interaction  research  studies  were  worthwhile^ 
the  practical  application  in  the  classroom  of  cognitive  style 
specific  instructional  conditions  proved  impossible. 
Fortunately^  today  the  micro-computer  has  changed  this  situation 
by  allowing  for  highly  individualized  instructional  programs  to 
address  specific  learning  needs. 

The  cognitive  styles  examined  in  the  present  study  are 
field-dependents- independents  and  ref lectivity-impulsivity.  A 
definition  of  both  of  these  cognitive  styles  is  provided  in  the 
above  listing  by  Messick,  howev^:*r  a  few  more  points  on  these 
cognitive  styles.    Pield-dependents-independents  was  originally 
researched  by  Witkin  (1954}.    His  original  work  lead  to  a  large 
number  of  studies  on  fd-fi  (Witkin,  Oltman,  1973 with  this 
research  yielding  results  having  significant  implications  for 
instruction  and  learning  (Witkin  and  Moore,  1975).    In  terms  of 
viewing  an  instructional  display,  the  field-independent  student 
will  be  able  to  abstract  relevant  information  more  easily, 
probably  acquire  information  more  quickly,  and  require  fewer 
individual  cues.    On  the  other  hand,  the  field-dependent 
individual  will  have  more  difficulty  identifying  relevant 
to-be-learned  information  from  the  visual  instructional  display, 
and  will  have  more  difficulty  learning  from  complex  visual 
displays.    On  the  other  hand,  the  field-dependent  student  may 
learn  better  with  more  visual  cues  and  more  reinforcement.  So 
the  basics  of  designing  an  instructional  display  should  differ 
significantly  contingent  upon  relative  field-dependency  or 
field- independency.    Thus,  knowledge  of  fd  or  fi  can  predict  how 
to  design  instructional  events,  and  MCBI  instructional  displays. 

Early  work  on  reflectivity  and  impulsivity  was  carried  out 
by  Kagan  (1965;  Kagan,  Rossman,  et.al.,  1964).    Recent  research 
on  this  cognitive  style  has  been  carried  out  by  Ernest  Barratt. 
An  extensive  series  of  studies,  now  done  by  Barratt  examines  th«3 
reflectivity  and  impulstivity  cognitive  style  (Barratt,  and 
Pattan,  1983;  Barratt,  1980;  Barratt,  1972;  Barratt,  1965). 
Similar  to  fd-fi,  the  ref lectivity-impulsivity  cognitive  style 
has  implications  for  how  students  deal  with  the  instructional 
environment,  and  specific  instructional  displays.    For  example, 
the  impulsive  learner  may  be  less  likely  to  view  an  instructional 
display  for  the  correct  amount  of  time,  or  may  not  attend  to 
visual  detail.    Therefore,  external  pacing  strategies  may  be 
needed  in  the  MCBI  program,  to  deal  with  the  impulsive  cognitive 
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style*    Additionally  the  impulsive  cognitive  style  may  avoid 
feedback  loops r  or  additional  study  when  needed,  so  these 
considerations  should  be  designed  into  tl  e  MCBI  program. 
However r  the  reflective  cognitive  style  may  find  such  built  in 
strategies  debilitating^  so  a  cognitive  shyle  specific 
instructional  program  may  prove  more  effective • 

Cognitive  style  variables  are  so  pervasive  in  learners r  and 
such  powerful  psychological  systems r  it  would  seem  that  cognitive 
styles  should  serve  as  a  basic  consideration  for  the  design  of 
MCBI  instructional  programs.    Along  with  the  optimal  design  of 
visual  displays  and  pace  considerations,  cognitive  style  effects 
may  help  instructional  developers  design  optimal  MCBI  programs 
for  most  learners. 

Experimental  Desic;ns 

The  present  research  study  involves  three  experimental 
designs,  two  investigating  the  cognitive  style  of 
field-dependents  and  field-independents  and  one  evaluating  the 
reflectivity  and  impulsivity  variable. 

The  first  fd,fi  experimental  design  is  represented  by  figure 
-1«    The  fd,fi  variable  was  determined  using  the  Thruston  Embedded 
Figures  Test.    Two  hundred  experimental  subjects  were  tested  for 
fd,fi.    The  fd;fi  scores  were  analyzed  and  split,  so  that  the 
middle  portion  of  the  scores  were  eliminated  leaving  scores  that 
were  as  close  to  beting  fd  or  fi  as  possible.    This  left  112 
subjects  to  participate  in  the  study.    These  112  subjects  were 
then  split  into  fd  anc?  fi  groups  based  upon  their  relative  fd  and 
fi  scores. 

The  programmed  instructional  (PI)  texts  instructed  subjects 
on  the  parts  of  the  human  hea'^t  and  how  the  heart  operated 
(Dwyer,  1987).    Each  PI  text  contained  visual  and  verbal 
information  in  an  instructional  display,  followed  by  an 
insUructional  question  and  feedbacks    Each  PI  text  had  exactly  37 
instructional  displays,  and  37  instructional  questions,  for  each 
display.    The  ?I  texts  simulated  a  computer  display  in  style,  and 
served  as  a  pilot  set  of  instructional  materials  for  later 
computer  programming.    There  were  two  types  of  visuals  evaluated, 
and  two  types  of  feedback  evaluated  in  the  PI  texts.    The  first 
visual  type  was  a  simple  line  drawing  of  the  heart.    While  this 
visual  type  vras  complete,  with  all  correct  information,  finer 
detail  was  aot  in  the  visual.    The  second  visual  was  a  detailec? 
line  drawing,  which  included  the  same  basic  information  as  the 
simple  line  drawing,  but  with  added  detail.    Both  visual  types 
were  in  black  and  white.    An  instructional  display  consisted  of  a 
visual  of  the  heart,  labels  indicating  heart  parts    r  operations, 
•^we  specifying  parts  or  operations,  anc?  a  brief  verbal 
it ion  under  each  visual. 

ie  two  types  of  feedback  were  verbal  or  visual.    On  the 
I  feedback  condition,  after  the  subject  responded  to  the 
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instructional  question,  the  PI  text  pago  was  turned  and  the 
correct  answer  was  then  provided  in  verbal  form.    In  the  visual 
feedback  condition ,  after  the  subject  responded  to  the 
instructional  question,  the  page  was  turned  and  a  heart  visual 
appeared  with  the  correct  answer  in  verbal  form  and  an  arrow 
identifying  the  process  or  part  on  the  visual.    The  two  visual 
types  and  two  feedback  types  resulted  in  the  following  four  PI 
Instructional  conditions. 

1)  Simple  line  drawing  plus  verbal  text,  and  visual 
feedback. 

2)  Detailed  line  drawing  plus  verbal  text,  and  visual 
feedback. 

3)  Simple  line  drawing  plus  verbal  text,  and  verbal 
feedback. 

4)  Detailed  line  drawing  plus  verbal  text,  and  verbal 
feedback. 

After  working  thru  the  PI  texts  at  their  own  pace,  subjects  were 
given  a  recall  test.    There  were  two  types  of  visual  tests 
evaluated:    1)  Free  recall  visual  test.     2)  Cued  recall  visual 
test.    The  free  recall  visual  test  required  the  subject  to  draw  a 
picture  of  the  human  heart,  with  the  parts  indicated  and  labeled, 
and  show  the  correct  blood  flow.    The  cued  recall  visual  test 
required  the  subject  to  draw  a  picture  of  the  heart  with  the 
parts  indicated,  this  test  had  a  listing  of  the  parts  provided  in 
random  order  at  the  bottom  of  the  page.    As  with  free  recall 
test,  on  the  cued  test  blood  flow  had  to  be  shown.    Both  test 
types  had  20  possible  points. 

The  second  experimental  design  is  represented  in  figure  4. 
The  second  experimental  design  involved  the  same  subjects,  the 
same  Pi  texts,  but  different  test  types.    This  experimental 
design  used  verbal  testing  in  place  of  the  visual  tests  from  the 
first  experimental  design.    There  were  three  types  of  verbal 
tests  (each  had  20  points): 

1)  List  Learning:  list  the  heart  parts  and  operation  names. 

2)  Simple  concept  learning:  given  a  multiple  choice  question 
describing  the  attributes  of  a  part  or  operation, 
identify     ^  the  correct  concept. 

3)  Complex  concept  learning:  given  a  multiple  choice 
question  which  describes  the  interacting  operation  of 
heart  functions,  identify  the  function,  relationships,  or 
interacting  parts. 

The  third  experimental  design  was  not  a  true  experimental 
design,  as  were  one  and  two.  This  design  was  a  pilot  study  to 
evaluate  performance  of  the  s>      »ct  pool  on  the  Barratt's 
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reflectivity  and  impulsivity,  cognitive  style  test.    Using  a 
subject  pool  from  another  experiment  completed  at  Ohio  State,  180 
experimental  subjects  were  given  the  Barratt  test.    The  Barratt 
ref lectivity-impulsivity  test  has  three  subscales  to  evaluate  a 
subjects  relative  impulsivity  or  reflectivity 

1 )  Non-planning 

2)  Motor  response 

3)  Cognitive 

The  first  scale  deals  with  the  ability  to  plan  for  future 
actions ,  the  second  deals  with  motor  behavior  of  a  physical 
nature.    The  cognitive  scale  deals  with  intellectual  skill 
activities.    The  subject  pool's  reflectivity- impulsivity  scores 
were  normed  for  a  future  experiment  on  this  cognitive  style,  and 
to  determine  which  subscale  to  use  for  a  future  experiment  with 
micro-computer  based  instruction.    Norms  on  the  Barratt  test 
currently  do  not  exist  for  college  freshmen,  our  subject  pool. 
Additionally,  the  scores  may  vary  across  the  scales.    In  other 
words  a  subject  may  be  high  cognitive  impulsive,  and  low  motor 
impulsive.    Therefore,  it  was  necessary  to  determine  which  scale 
predicted  relative  impulsivity  vs.  reflectivity  for  this  subject 
pool.    This  data  on  the  Barratt 's  scales  was  collected  as  part  of 
a  separate  experiment,  and  analyzed  using  a  psuedo-experimental 
design  to  evaluate  subscale  mean  differences. 

The  Barratt  test  norms  will  be  used  in  a  future  study  to 
evaluate  the  effects  of  reflectivity  and  impulsivity  on  learning 
from  micro-computer  based  instructional  programs. 

Results  and  Discussion 

The  first  experimental  design  resulting  analysis  of  variance 
is  summarized  in  Table-1.    The  Table-1  data  yields  a  number  of 
significant  results.    The  instructional  type  variable  was 
significant.    A  Tukey  follow-up  test,  at  .05  alpha,  indicated 
that  the  PI  instructional  text,  with  a  line  drawing  visual  and 
visual  feedback,  produced  a  higher  mean  score  overall  oh  the 
visual  tests  (Table  2).    The  more  detailed  line  drawing  with 
verbal  feedback  produced  a  significantly  lower  score.  The 
detailed  line  drawing  plus  visual  feedback  means,  and  line 
drawing  plus  verbal  feedback  scores  did  not  differ. 

The  line  drawing  visual  type  appears  to  have  an  adequate 
amount  of  visual  information  for  learning,  and  when  paired  with 
visual  feedback,  significantly  improves  learning.    The  added 
detail  in  the  detailed  line  drawing  did  not  significantly  improve 
learning,  however  this  added  detail  would  significantly  add  to 
programming  complexity  for  MCBI.    Additionally,  visual  feedback 
is  better  overall,  and  is  better  than  verbal  feedback  alone. 

In  general,  the  fi  yroup  outperformed  the  fd  group,  and  cued 
recall  was  not  as  difficult  as  free  recall  (Table-2).  These 
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results  are  expected  from  past  research  on  fd,  fi  and  cued^  free 
recall. 

A  significant  interaction  occurred  between  instruction  and 
testing  type,  the  means  involved  in  this  interaction  appear  in 
Table-2f  with  a  graph  of  the  interaction  in  Pigure-2.    The  source 
of  the  interaction  is  the  Pl-text  type  of  line  drawing  plus 
visual  feedback.    This  instructional  condition  produced  a  highly 
significant  improvement  in  learning  performance  on  the  cued 
recall  visual  test.    As  in  the  main  effect  mean  differences,  this 
line  drawing  instructional  display  condition,  with  visual 
feedback,  was  better  for  learning  visual  information  than  a 
detailed  line  drawing  and  verbal  feedback.    However,  free  recall 
of  visual  information  remains  a  difficult  task  as  indicated  by 
the  mean  scores  in  Table-2. 

A  significant  interaction  occurred  between  fd,  fi  and  test 
type  (Table-2,  Pigure-3).    The  field-independent  group  did 
significantly  better  on  the  cued  recall  test  than  did  the 
field-dependent  group,  but  both  cognitive  styles  had  more 
difficulty  with  the  free  recall  visual  test. 

Interestingly,  a,  highly  significant  finding,  is  the  lack  of 
significance  found  in  the  second  experimental  design  (Pigure-4). 
The  Table-3  analysis  of  variance  results  indicated  that  verbal 
testing  alone  failed  to  reveal  performance  differences,  in 
pCoTformance  with  the  cognitive  style  of 
field-dependents-independents.     In  other  words,  if  the' 
experimenters  used  only  verbal  tests,  and  not  visual  testing,  our 
results  would  have  been  quite  different,  or  insignificant.  This 
lack  of  significance  with  verbal  testing,  using  the  same 
instruction  and  same  subjects,  points  out  a  key  issue  with 
cognitive  style  research;  testing  conditions  for  intellectual 
performance  must  be  sensitive  to  the  cognitive  style  factors 
being  examined.    The  cognitive  style  will  always  be  at  work, 
since  it  is  an  innate  psychological  factor,  but  if  criterion 
tests  are  insensitive  to  the  cognitive  style  examined,  results 
will  fail  to  reveal  performance  differences.    A  comparison  of  the 
Table-1  and  Table-3  results  makes  this  principle  obvious,  and 
yields  the  conclusion  that  visual  testing  should  be  a 
consideration  for  examining  the  field-dependent  and 
field-independent  cognitive  style.     In  addition,  it  makes  obvious 
the  need  for  pilot  testing  instructional  and  testing  materials 
for  cognitive  style  sensitivity,  when  researching  cognitive 
styles  and  instructional  factors. 

Well,  what  did  we  learn  from  this  preliminary  analysis  for 
our  next  study  on  MCBI?    First,  our  MCBI  instructional  programs 
will  eliminate  the  detailed  drawing,  plus  verbal  feedback 
condition.     This  instructional  condition  will  be  replaced  with  a 
condition  to  examine  visual  cuing  during  instruction,  and  if  this 
extra  visual  cuing  will  improve  free  recall  test  scores,  and 
overall  visual  test  scores  for  field-dependents.     Secondly  in  our 
next  MCBI  study,  with  the  original  three  Pl-Instructional 
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conditions  adapted  to  MCBI,  we  plan  to  eliminate  verbal  testing. 
However,  along  with  the  free  recall  and  cued  recall  visual  tests , 
we  will       add  a  visual  oriented  test  to  evaluate  concept 
understanding.    In  other  words,  this  third  test  will  evaluate 
conceptual  ability  with  the  heart  content,  but  include  a  visual 
dimension  during  testing.    Thirdly,  in  the  follow-up  study,  from 
this  pilot  study,  we  will  furth  ^  evaluate  fd  and  fi,  but  with 
the  added  effects  of  an  MCBI  meu.  od  of  instruction,  a  visual  cue 
oriented  instructional  condition,  and  a  visual  concept  test. 

The  psuedo-experimental  design  is  summarized  in  Table-5, 
relevant  ref lectivity-impulsivity  mean  scores  are  presented  in 
Table-6.    While  this  analysis  includes  data  from  another  study, 
the  only  relevant  variable  is  the  cognitive  style  mean  scores, 
and  in  Table-5  the  data  listed  as  3-Subscales.    This  relectivity 
and  impulsivity  data  was  collected  as  part  of  another  study 
evaluating  8  instructional  conditions.    The  analysis  of  variance 
design  in  Table-5  was  only  used  to  norm  the  3 
reflectivity- impulsivity  subscales  for  future  work. 

The  three  subscale  means  proved  to  be  statistically 
different  for  this  group  of  180  college  freshmen.     They  tended  to 
be  more  highly  cognitively  impulsive  (18.71),  than  planning 
impulsive  (14.92),  and  motor  impulsive  (16.93).  Additionally, 
their  overaill  mean  scores  on  the  three  subscales  tenc'.ed  to 
fluctuate  a  great  deal  from  subject  to  subject.    Therefore,  it 
may  be  difficult  to  use  all  three  subscales  in  one  experimental 
design,  but  better  to  examine  one  subscale  at  a  time.     Since  the 
cognitive  subscale  seems  to  relate  more  closely  to  academic  work, 
our  next  cognitive  style  experiment  dealing  with 
reflectivity- impulsivity,  will  evaluate  relative  performance 
using  the  cognitive  subscale. 

Finally,  these  norms  on  the  three  subscales  are  valid  for 
college  freshmen,  since  our  subject  sample  size  was  18j  in  this 
case.    However,  since  little  is  known  about 

reflectivity- impulsivity  for  college  students,  more  should  be 
done  on  developing  norms  on  the  Barratt  test  on  this  cognitive 
style. 
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LP,  Vis.F.        DP,  Vis.F.   LP,  Ver.F.  DP,  Ver.F. 


Line  Drawing, 
Visual  Feed. 

Detailed  Drawing, 
Visual  Feed. 

Line  Drawing, 
Verbal  Feed. 

Detailed  Drawing, 
Verbal  Feed. 

fi 

fd 

fi 

fd 

fi 

fd 

fi 

fd 

Cued 

Free 

Figure  1;    Visual  testing,  fdfi.  Experimental  Design 


Source 

Mean_S3. 

Pf 

F-Ratio 

P 

Instruction  (I) 

34.68 

3 

2.77 

.05 

(fi)  X  (fd) 

52.94 

1 

4.23 

.04 

(I)  X  (fd,fi) 

17.72 

3 

1.42 

.24 

Test  (T) 

167.58 

1 

13.39 

.001 

(I)   X  (T) 

35.79 

3 

2.86 

.04 

(T)  X  (fd,fi) 

87.51 

1 

6.99 

.01 

(T)  X  (I)  X  (fd,fi) 

5.29 

3 

.42 

.74 

Error 

12.51 

96 

Table  1:    ANOVR  Summary  Table  Visual  Testing 
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Instruction  Means: 


LDr  Vis.F. 
7.82 


DP,  Vis.F. 
6.68 


LP,  Ver.F. 
6.50 


PP,  Ver.F. 
5.11 


fi  X  fd  Means; 
fi 


fd 
5.82 


Test  Means: 


free 
5.30 


cued 
7.75 


Instruction  x  Test  Interaction  Means; 


(LP,  Vis.F. ) 

Free,  Cued 
4.73,  10.71 


(PD,  Vis.F. ) 

Free,  Cued 
6.29,  7.07 


(LP, Ver.F. ) 

Free,  Cued 
5.64,  7.36 


Test  X  fd,fi  Means 

(Free  Recall) 

fir 

5.11 


(PP,  Ver.F. ) 

Free,  Cued 
4.36,  5.86 


(Free  Recall) 
fd, 
5.5 


(Cued  Recall) 

fir 
9.32 


(Cued  Recall) 
fd, 
6.18 


Table  2i_  Si£n_if i^cant  Re£ult_in£  Means,_Vi^sual  Test_in£  Ex£eriment_ 
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LP,  Vis.F. 


DP,  Vis.F. 


LP,  Ver.F. 


PP,  Ver.F. 


Line  Drawing, 
Visual  Feed. 

Detailed  Drawing, 
Visual  Feed. 

Line  Drawing, 
Verbal  Feed. 

Detailed  Drawing, 
Verbal  Feed. 

fi 

fd 

fi 

fd 

fi 

fd 

fi 

fd 

List 
Learn 

Simple 
Concept 

Complex 
Concept 

Figure  4;    Verbal  testing,  fdfi,  Experimental  Pesign 
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Source 

Mean  S£. 

Df 

F-Ratio 

P 

Instruction  (I) 

34.89 

3 

.964 

.41 

fd,fi 

128.76 

1 

3.56 

.06 

(I)  X  (fd,fi) 

40.69 

3 

1.13 

.34 

Error 

36.18 

104 

Tests  (T) 

171.74 

2 

28.88 

.001 

(I)  X  (T) 

7.85 

6 

1.32 

.25 

(fd,fi)  X  (T) 

5.32 

2 

.90 

.35 

{fd,fi)  X  (I)  X  (T) 

6.03 

6 

.42 

.39 

Error 

5.94 

208 

Table  3: 

ANOVR  Summary  Table  Verbal  Testing- 

List  =  11.01;     Simple  Concept  = 

10.26;  Complex  =  9.13 

Table 

4:     Significant  Testing  Means 

Source 

Mean_S3. 

Df 

F-Ratio 

P 

By  Group 

53.59 

7 

1.35 

.23 

Error 

39.76 

152 

3-Sub  Scales 

576.34 

2 

32.99 

.001 

Interaction 

16.87 

14 

.97 

.49 

Error 

17.47 

304 

Table  5 ;  ANOVR:  Reflectivity  Impulsivity  Norms; 
Psuedo  Experimental  Design  Results 


2-Sub  Scale  Mean^ 
Non -Planning  Motor  Co2ni^t_ive 

14.92  16.93  18.71 

Table  6l     Significant  Reflectivity  x  Impulsivity  Means 
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DELAY  OF  FEEDBACK  AND  COGNITIVE  TASK  LEVEL. 
IN  PRACTICE  EXERCISES 


Feedback  is  a  key  element  in  a  sequence  of 
instruction.     It  is  the  means  by  which  a  learner  is  able  to 
judge  his  or  her  performance.     Without  feedback,  a  learner  is 
left  to  perform  with  no  sense  of  direction  or  measure  of 
correctness. 

Weiner  first  identified  feedback  in  his  book 
Cybernetics  (1948).     He  envisioned  systems  that  were  goal- 
seeking^  taking  small  steps  toward  a  predetermined  goal* 
Feedback  was  the  information  which  returned  to  the  -^^vstem 
after  each  step  so  that  the  system  could  adjust  per£,/rmance 
on  the  next  step  in  order  to  reach  the  specified  goal.  Thus, 
feedback  served  to  determine  the  direction  in  which  the  next 
step  was  Uken. 

Feedback  as  a  formal  component  of  instruction 
became  prevalent  in  the  1960*s  with  the  widespread  use  of 
programmed  instruction.     Learning  theorists  called  for 
feedback  as  an  integral  part  of  the  instructional  process 
vrhile  instructional  designers  included  feedback  as  a  formal 
step  in  the  instructional  process. 

Feedback  has  been  studied  widely  since  the  I960*s. 
Researchers  have  found  varying  degrees  of  importance  of 
feedback,  as  well  as  conflicting  ideas  in  the  ideal 
application  of  feedback  for  instructional  purposes..     At  least 
some  of  the  differences  in  opinion  in  feedback  research  can 
be  attributed  to  the  many  dimensions  of  feedback  and  the 
difficulty  that  exists  in  trying  to  control  all  of  these 
dimensions.     This  paper  is  concerned  with  the  dimension  of 
timing  of  feedback. 

Timing  of  feedback  refers  to  the  amount  of  time 
that  elapses  between  the  student^s  response  and  the 
presentation  of  feedback.     This  interval  may  be  immediate  or 
it  may  be  delayed  5  seconds,  5  minutes,  an  hour,  or  a  day. 

The  Behaviorists *  view  of  feedback  (Robin,  1978; 
Skinner,   1968;  Weiner,   1948)  was  that  it  served  as  a 
reinforcer.     This  point  of  view  required  that  feedback  be 
provided  immediately  after  the  desired  behavior  in  order  to 
reinforce  the  b<ihavior  and  increase  the  likelihood  that  it 
would  be  repeated. 

Brackbill  and  her  associates  (1962),  in 
experiements  with  third  grade  boys,  found  fhat  delaying  the 
presentation  of  feedback  for  as  little  as  5  seconds 
contributed  to  the  increase  of  scores  on  retention  tests 
given  8  days  after  the  initial  learning.     This  increase  in 
retention  after  a  delay  in  feedback  has  been  named  the  Delay- 
Retention  Effect  (DRE). 
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The  explanation  offered  by  Brackbill  and  her 
associates  for  the  Delay-Retention  Effect  was  that  the  delay 
of  feedback  provided  greater  resistance  to  forgetting, 
Sturges  and  Crawford  (1964)  proposed  that  the  DRE  could  be 
explained  by  the  fact  that  those  receiving  delayed  feedback 
spent  the  delay  interval  rehearsing  the  questions.  This 
verbal  rehearsal  theory  was  also  proposed  by  Sturges  (1969) 
and  Sassenrath  and  Yonge  (1968,   1969),     However,  no  one  was 
able  to  support  this  verbal  rehearsal  theory  with  research 
results • 

Kulhavy  and  Anderson  (1972)  proposed  the 
Interference  Perseveration  Theory  (IPT)   as  the  reason  for  the 
DRE.     The  IPT  stated  that 

, , , learners  forget  their  incorrect  responses  over 
the  delay  interval,  and  thus  there  is  less 
interference  with  learning  the  correct  answers  from 
the  feedback.     The  subjects  who  receive  immediate 
feedback ,  on  the  other  hand ,  suffer  from  proactive 
interference  because  of  the  incorrect  responses  to 
which  they  have  committed  themselves,  (p«506). 

While  this  explanation  applies  to  answers  that  are 
initially  incorrect,   it  does  not  apply  to  initially  correct 
answers,     "The  delay  is  not  an  issue  in  the  case  of  a 
positive  feedback  since  there  is  no  competing  response," 
(Joseph  and  Maguire,   1982,  p,  360) 

The  Interference  Perseveration  Theory  has  been 
supported  by  several  researchers  (Bar dwell,    1982;  Sassenrath, 
1972,   1975;  Sturges,   1978;  Surber  and  Anderson,   1975).  While 
others  (Peeck,  Van  Der  Bosch,  and  Kreupleling,  1985; 
Sassenrath  &  Yonge,   1968;  Sturges,   1978;  Tabachneck,  1982) 
have  challenged  the  IPT,   there  have  been  no  rival  theories 
presented  and  supported , 

The  timing  of  feedback  has  been  investigated 
extensively  over  the  past  twenty-five  years,  with  most  of  the 
research  completed  in  the  mid-1970 ' s ,     There  has  been  a 
resurgence  of  feedback  research,  however,  in  the  1980* s  which 
reflects  the  interest  in  the  effective  design  of  computer- 
assisted  courseware.     Research  on  retention  and  the  timing  of 
feedback  typically  uses  a  paradigm  that  involves  a  pretest  or 
initial  exposure  to  the  items,  a  delay  interval  before  the 
feedback ,  an  immediate  post test  after  the  feedback ,  and  a 
delayed  posttest  after  another  delay  interval,     (See  Figure 
1)     The  immediate  posttest  provides  a  measure  of  initial 
acquisition  while  the  delayed  posttest  provides  a  measure  of 
the  retention  of  learning. 
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Insert  Figure  1  here 


One  variable  that  has  contributed  to  the  research 
on  delay  of  feedback  is  that  of  the  cognitive  level  of  the 
tasks  on  which  feedback  is  provided.     Many  researchers  have 
suggested  that  delayed  feedback  is  better  for  the  higher 
cognitive  levels  (Anderson,  Kulhavy  and  Andre,  1971; 
Bardwell,   1982;  Brackbill,   1964;  Gaynor,   1981;  Kulhavy  and 
Anderson,   1972;  Markowitz  and  Renner,   1966;  Sturges,  1978), 
but  few  studies  have  been  conducted  to  determine  the 
relationship  of  timing  of  feedback  and  cognitive  level  of  the 
task.     Of  those  studies  which  have  dealt  with  this  topic 
(Gaynor,   1973,   1981;  Pound,   1977;  Quiring,   1971;  Tabachneck, 
1982),  none  have  found  a  significant  relationship  between  the 
timing  of  feedback  and  the  cognitive  level  of  the  task. 

This  paper  reports  the  findings  of  a  study  on  the 
relationship  of  timing  of  feedback  and  three  cognitive 
levels  of  the  tasks  completed.     The  tasks  for  this  study  were 
classified  according  to  the  cognitive  levels  used  in  Gagne's 
hierarchy  of  learning  (1985).     This  hierarchy  was  chosen,  as 
opposed  to  those  proposed  by  other  educators  such  as  Bloom 
(1956),   because     1)  it  is  widely  accepted  in  the  field  of 
instructional  design,     2)  it  is  based  on  the  postulate  that 
the  mental  processing  required  for  each  type  of  learning  and 
retention  is  different,     3)  there  is  a  body  of  research  that 
also  uses  this  hierarchy,  and     4)  prior  studies  with 
accounting  have  classified  the  accounting  tasks  with  this 
hierarchy. 

This  study  differed  from  prior  studies  on  the 
relationship  of  the  timing  of  feedback  and  cognitive  levels 
in  that  the  tasks  were  of  a  hierarchial  nature;   that  is,  task 
2  built  on  the  knowledge  gained  in  task  1.     In  addition,  the 
study  was  conducted  in  multiple  sessions  over  a  five  week 
period  while  most  delay-of -feed back  studies  have  used  a 
single  session  for  presentation  of  the  learning.  Finally, 
this  study  differed  from  prior  studies  in  that  the  treatments 
and  dependent  measures  were  all  administered  on  the  computer. 

The  hypotheses  for  this  study  were: 
HI  On  the  low  cognitive  level  task,  subjects  in  the 

immediate  feedback  group  will  score  significantly 
higher  on  the  delayed  posttest  than  subjects  in  the 
next- session  feedback  group • 
H2  On  the  high  cognitive  level  task,  subjects  in  the 

next-session  feedback  group  will  score 
significantly  higher  on  the  dealyed  posttest  than 
subjects  in  the  immediate  feedback  group,  after 


117 

124 


FEEDBACK  IN  PRACTICE 


4 


equating  the  two  groups  on  knowledge  from  the  prior 
tasks. 

METHODS 

Sub  iects 

Subjects  were  195  students  from  the  Principles  of 
Accounting  I  course  at  the  University  of  Texas  at  Austin  in 
the  Fall  of  1987.     Four  sections,,  taught  by  two  assistant 
instructors,   were  designated  by  the  supervising  professor. 
One  section  was  assigned  as  the  control  group.     Students  from 
the  other  three  sections  were  randomly  assigned  to  the  three 
treatment  groups  as  they  entered  the  computer  lab  for  the 
first  time.     Students  who  participated  were  given  additional 
credit  toward  their  final  grade  in  the  course. 

Accounting  was  chosen  as  the  topic  for  these 
exercises  because  there  are  a  lot  of  concepts,  rules,  and 
problem-solving  tasks  that  must  be  completed  early  in  the 
Principles  of  Accounting  course.     This  knowledge  must  be 
learned  within  the  first  four  to  f i\ e  weeks  of  the  semester. 
Without  this  basic  knowledge,  students  are  unable  to 
understand  the  course  content  that  follows  and  how  it  relc^es 
to  their  future  careers. 

Design 

The  study  used  a  quasi-exper J  mental  design  with 
subjects  in  four  groups: 

control — an  intact  section  taking  only  the  written 
pretest  and  a  written  delayed  posttest 

immediate  feedback  treatment  group — took  the 

written  pretest,   then  completed  13  sessions  on 
the  computer,  with  feedback  immediately  after 
each  incorrect  answer 

end-of-session  (EoS)  feedback  treatment  group — took 
the  written  pretest,   then  completed  13  sessions 
on  the  computer,  with  feedback  on  incorrect 
answers  given  at  the  end  of  each  computer 
session 

next-session  feedback  treatment  group — took  the 
written  pretest,   then  completed  14  sessions  on 
the  computer,  with  feedback  on  incorrect  answiers 
given  at  the  beginning  of  the  next  session 
following  the  session  in  which  the  exercise  was 
completed 
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The  tasks  involved  in  the  treatment  sessions  were 
classified  into  three  cognitive  levels; 

Level   1  (low  cognitive  level);     Defined  Concept 

The  task  was  classifying  accounts 
Level  2  (medium  cognitive  level);  Rules 

The  task  was  specifying  debit  or  credit  for  an 

increase  or  decrease  to  accounts 
Level  3  (high  cognitive  level);  Problem-solving 

The  task  w&s  choosing  the  correct  adjusting 

entry,   given  a  particular  situation 

Instruments 

Four  parallel  tests  for  each  of  the  three  cognitive 
levels  were  developed.     The  written  pretest  was  given  on  the 
second  day  of  class  to  subjects  in  both  the  control  and  the 
treatment  groups  and  contained  questions  on  all  three 
cognitive  levels,     A  background  questionnaire  was  completed 
on  the  same  day. 

The  embedded  pretest,  the  immediate  posttest  and 
the  delayed  posttest  were  given  to  the  subjects  in  the  three 
treatment  groups  as  a  part  of  their  computer  sessions.  The 
delayed  posttest  was  given  to  the  control  group  as  a  written 
in-class  activity,  at  approximately  the  £»ame  time  in  the 
semester  as  most  of  the  treatment  subjects  took  it, 

A  week  after  the  study  ended  a  followup 
questionnaire  was  completed  by  subjects  in  the  three 
treatment  groups. 

Materials 

The  computer  program  used  to  provide  the  practice 
exercises  was  a  researcher-designed  program,   based  on  a 
linear  design.     The  design  features  of  the  program  included 
instructions  on  each  new  task,  a  review  of  the  in-class 
learning  for  the  new  tisk,  single  keystroke  responses, 
feedback  on  incorrect  answers  only,  and  the  requirement  to 
hit  the  space  bar  before  proceeding  after  feedback  had  been 
presented.     The  program  was  written  in  PC  Pilot  and  operates 
on  an  IBM  PC  computer  with  monochrome  monitor  and  256K  of 
memory.     No  other  materials  were  necessary. 

Each  session  contained  a  specified  number  of  items 
for  each  cognitive  level,  (See  Table  1)  The  items  for  each 
session  were  drawn  from  the  item  pool,  with  no  item  repeated 
in  the  same  session,  and  with  each  item  repeated  three  times 
in  the  course  of  the  study ♦  For  the  immediate  and  end-of- 
session  treatment  groups,  13  sessions  were  required  to 
complete  the  exercises;  for  the  next-session  group,  14 
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Insert  Tables  1  and  2  here 


Subjects  were  asked  to  complete  no  more  than  one 
session  per  day,  with  an  average  of  three  sessions  per  week 
in  order  to  coordinate  the  exercises  with  their  in-class 
learning • 

i/if f erent  screen  designs  were  used  for  each  of  the 
three  cognitive  levels  and  their  associated  tasks.  Figures 
1,  2,  and  3  show  the  three  screen  designs. 


Insert  Figures  2, 3, and  4  here 


As  a  subject  pressed  the  key  for  his/her  choice, 
the  key  was  highlighted  on  the  screen.     Feedback  was  given 
only  on  incorrect  answers.     This  feedback  consisted  of  an 
arrow  pointing  to  the  correct  answer .     When  feedback  was 
given,  subjects  in  the  immediate  feedback  treatment  group 
could  still  see  the  highlighted  key  which  indicated  their 
answer  choice.     End-of -session  and  next-session  treatment 
groups  were  not  shown  their  original  answer  when  they  were 
given  feedback. 

No  feedback  was  given  on  the  post tests  and  the 
items  presented  on  the  posttests  were  not  counted  as  item 
repetitions . 

Procedure 

On  the  second  day  of  class  for  the  semester  all 
groups  were  given  the  written  pretest  and  the  background 
questionnaire.     Subjects  in  the  three  sections  which  were  not 
the  control  group  were  told  that  several  software  designs 
were  being  tested  and  were  asked  to  report  to  the  computer 
lab  within  the  next  few  days  to  begin  their  computer 
sessions . 

As  they  entered  the  computer  lab  they  took  a  disk 
from  the  front  of  the  storage  box,   wrote  their  identifying 
number  on  it,  and  began  work  at  the  computer.     Each  disk 
was  preprogrammed  and  contained  the  sessions  appropriate  to 
the  treatment  group.     Thus,   students  were  randomly  assigned 
to  a  treatment  group  as  they  took  their  disk. 

Students  completed  one  session  at  a  time,   with  no 
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more  than  one  session  per  day.     At  the  end  of  each  session 
their  performance  information  was  written  to  the  disk  and 
they  refiled  the  disk.     At  their  next  session  they  took  their 
disk  and  completed  their  work.     Thus,  subjects  completed 
their  work  at  their  own  pace.     All  sessions  could  be 
completed  as  early  as  the  thirteenth  day  or  as  late  as  the 
end  of  the  fifth  week,  which  was  the  time  limit  for  the 
study.     Students  were  given  a  suggested  time  line  and  asked 
to  stay  as  close  to  it  as  possible  in  order  to  maximize  the 
effect  of  the  computer-assisted  exercises. 

A  week  after  the  deadline  for  completion  of  the 
computer  exercises ,  a  questionnaire  on  the  program  design  and 
student  attitudes  about  it  was  completed  by  subjects  who  had 
done  the  exercises. 

RESULTS 

In  order  to  determine  if  the  groups  were  equivalent 
a  One-Way  Analysis  of  Variance  was  completed  on  the  pretest 
scores  for  each  of  the  three  cognitive  levels.     These  three 
ANOVAs  indicated  that  there  was  no  difference  between  the 
three  treatment  groups  and  the  control  group,  nor  among  the 
three  treatment  groups.     An  additional  Analysis  of  Variance 
was  completed  with  the  SAT  scores  for  subjects  in  the  four 
groups  and  it  confirmed  that  there  was  no  difference  in  the 
academic  ability,  as  measured  by  the  SAT,  of  the  four  groups. 

In  order  to  determine  that  the  treatment  was 
effective,   a  One-Way  Analysis  of  Variance  was  completed  on 
the  delayed  posttests  for  each  cognitive  level.     On  Level  1 
and  Level  2,  all  three  treatment  groups  performed 
significantly  better  (at  the   .001  level)  than  did  the  control 
group.     On  Level  3,  the  immediate  and  end-of -session 
treatment  groups  performed  significantly  better  than  the 
control  group,   but  the  difference  did  not  reach  the   .05  level 
of  significance  for  the  next-session  treatment  group. 

Since  the  groups  were  shown  to  be  equivalent  and 
the  treatment  was  effective,   the  control  group  was  not 
included  in  the  subsequent  analyses. 

In  order  to  determine  whether  to  reject  the  first 
null  hypothesis,  correlated  t-tests  were  completed  on  the 
Written  Pretest  and  the  Delayed  Posttest  for  Level  1.  There 
was  no  significant  difference  in  the  F  value  for  the 
immediate  feedback  treatment  and  the  next-session  feedback 
treatment  on  the  low  cognitive  level.     Therefore,  the  first 
null  hypothesis  was  not  rejected. 

For  the  second  null  hypothesis,  the  hierarchial 
nature  of  the  task  had  to  be  considered.     Since  the  treatment 
might  have  provided  an  advantage  to  increase  learning  at  the 
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lower  cognitive  levels,   thus  affecting  the  learning  at  the 
higher  cognitive  levels,  a  correction  factor  for  prior 
learning  had  to  be  employed •     Thus ,   the  embedded  pretest  was 
used  for  the  correlated  t--test  with  the  delayed  posttest, 
since  the  embedded  pretest  represented  the  level  of  knowledge 
of  problem-solving  that  the  subject  had  when  beginning  the 
problem-solving  activity*     The  results  of  the  correlated 
t-tests  were  not  significant*     Further,  an  Analysis  of 
Variance  of  the  Adjusted  Gain  Score  (delayed  posttest  minus 
embedded  pretest)  yielded  no  significant  difference  between 
the  treatments  on  the  high  cognitive  level  task  and  the 
second  null  hypothesis  was  not  rejected* 

Further  analysis  of  the  treatment  was  completed 
with  high  and  low  ability  subjects.     The  high  and  low  ability 
groups  were  based  on  those  subjects  with  SAT  scores  .25  of  a 
standard  deviation  above  or  below  the  mean.     Analyses  of 
Variance  were  completed  on  each  group ,   but  failed  to  yield 
any  significant  difference  in  the  treatments. 

An  Analyis  of  Variance  with  low  and  high  prior- 
knowledge  groups,  as  shown  by  the  total  pretest  scores,  was 
also  completed.     Using  the  top  and  bottom  quartiles  of  the 
pretest  scores,  ANOVAs  were  completed  on  the  delayed  posttest 
for  each  cognitive  level.     There  was  a  significant  difference 
for  the  three  treatment  groups  on  the  low  and  the  high 
cognitive  level  tasks.     Table  3  indicates  that  the  group  by 
pretest  interaction  on  the  Low  Cognitive  Level  was 
significant  at  the   .05  level,  while  Table  A  indicates  that 
the  group  by  pretest  interaction  on  the  High  Cognitive  Level 
was  significant  at  the  .01  level. 


Insert  Tables  3  and  4  here 


Figure  5  shows  that  on  the  Low  Cognitive  Level 
task,   the  next  session  feedback  was  more  effective  for  the 
low  prior-knowledge  group  than  for  the  high  prior-knowledge 
group.     Figure  6  indicates  that  there  was  a  significant 
advantage  to  high  prior-knowledge  subjects  when  using  the 
end-of-session  feedback  for  the  High  Cognicive  Level  task, 
while  low'  prior-knowledge  subjects  suffered  in  using  this 
treatment.     In  contrast ,   low  prior -knowledge  students 
performed  better  when  using  the  next-session  feedback  while 
high  prior-knowledge  students  did  not  perform  as  well. 


Insert  Figures  5  and  6  here 
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CONCLUSIONS  AND  RECOMMENDATIONS 

The  lack  of  significant  results  in  this  study  might 
be  attributed  to  several  factors; 

First,   there  was  an  apparent  ceiling  effect  on  the 
delayed  posttest,  as  evidenced  by  the  high  mean  scores.  This 
ceiling  effect  was  not  evident  on  the  pilot  study  of  the 
materials  completed;  however,  none  of  the  pilot  subjects  were 
coenrolled  in  the  Principles  of  Accounting  course. 

Second,   the  amount  of  knowledge  gained  through  co-- 
enrollment  in  the  accounting  course  and  its  required  readings 
and  homework  might  have  offset  the  effect  of  the  treatment. 
In  comparison  to  the  course  knowledge,   the  amount  of 
knowledge  transmitted  via  the  exercises  was  very  small. 
While  this  knowledge  did  contribute  to  superior  performance 
on  the  posttei-'^t,  when  compared  to  the  control  group,  much  of 
this  might  be  attributed  to  the  additional  time  on  task  and 
the  additional  practice  on  items  that  appeared  on  the 
posttest • 

Future  research  should  include  a  replication  of 
this  study  with  students  not  co-enrolled  in  the  accounting 
course.     Instructional  materials  could  be  prepared  which 
served  to  introduce  the  topics  drilled  on  the  computer 
exercises  within  this  study. 

Another  recommendation  would  be  the  further 
refinement  of  these  materials  to  include  questions  of  a  more 
difficult  nature  so  as  to  alleviate  the  ceiling  effext. 

A  recommendation  for  the  improvement  of  accounting 
education  would  be  to  include  computer-assisted  drills  during 
the  study  of  the  first  four  to  five  chapters.  This 
recommendation  is  warranted  by  the  high  correlation  of  the 
scores  on  the  deL'i  ed  posttests  of  the  treatment  groups  with 
the  scores  on  the  first  course  exam  (p  =  .002).     In  addition, 
an  ANOVA  of  the  first  exam  scores  between  those  who  completed 
the  treatments  and  those  in  the  control  group  approached  the 
level  of  significance.     With  the  relatively  small  investment 
of  time  (mean  time  on  the  treatments  was  lAA  minutes),  there 
is  a  significant  increase  in  course  achievement.     Of  course, 
additional  research  should  be  completed  in  the  area  of 
computer-assisted  accounting  drills. 

Finally,  more  research  is  needed  in  the  area  of  the 
relationship  of  the  timing  of  feedback  and  the  cognitive  task 
level  in  order  to  determine  whether  or  not  a  relationship 
exists  and  if  so,  what  that  relationship  is. 
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Tl 


dl 


F  T2  ^T3 

rl 


Tl  «  initial  exposure  to  the  item 
dl  «  delay  interval  before  feedback 
F    s  feedback 
T2  «  immediate  posttest 

rl  «  retention  interval  before  delayed  posttest 
T3  «  delayed  posttest 


Figure  1 

Paradigm  for  Delay-Retention  Effect  Research  Studies 
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Figure  2 

Screen  Design  for  Low  Cognitive  Level  Task  (Classifying 
Accounts) 
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XneraftBlng  and  Oacraaslno  Accounts 
4  of  30  * 


Xncr«a««  Unaxplrad  Xnsur«nc« 


Ooblt      I  D  I  I  K  }  Crodlt 


Plaasa  pross  tho  corroct  tc«y« 


Figure  3 

Screen  Design  for  Medium  Cognitive  Level  Task  (Increasing/ 
Decreasing  Accounts) 
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Figure  A 

Screen  Design  for  High  Cognitive  Level  Task  (Problem  Solving) 
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Figure  5 

Low  Cognitive  Level  Delayed  Posttest  Scores  by  Treatment 
Group  for  Low  and  High  Quartiles  on  Written  Pretest 
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Figure  6 

High  Cognitive  Level  Delayed  Posttest  Scores  by  Treatment 
Group  for  Low  and  High  Quartiles  on  Written  Pretest 
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Table  1 

Paradigm  Summary  for  Immediate  and  EOS  Treatment  Groups 


T  A  V  o  1  1 

Levpl  2 

Level  3 

Daily 

Session 

Classify 

IncDec 

Problems 

Total 

1 

60 

60 

2 

30 

30 

3 

20 

60 

80 

4 

20 

80 

100 

5 

20 

70 

90 

6 

20 

50 

10 

80 

7 

10  &  ipt 

40 

20 

70 

8 

30 

20 

50 

9 

30  &  ipt 

10 

40 

10 

dpt 

10 

10 

11 

10 

10 

12 

dpt 

10  &  ipt 

10 

13 

(a)  dpt 

Total 

180 

360 

90 

630 

Item  Repetitions  to  Number  of 

Total  Items  in  the  Pool  Sessions 


Classify  180:60  3,0  7 

IncDec  360:120  3.0  7^ 

Problems  90:30  3.0  7 


ipt  ^  immediate  post test 
dpt  =  delayed  posttest 


(a)     This  session  will  be  one  week  after  the  prior  session. 
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Table  2 

Paradigm  Summary  for  Next  Session  Delayed  Treatment  Group  (a) 


Level  1 

1  o  v  0 1 

oession 

L>j.assixy 

T  nf*  D p 

1 

fin 

2 

30 

Q 

60 

4 

20 

80 

5 

20 

70 

6 

20 

50 

7 

10 

40 

8 

ipt 

30 

9 

30 

10 

ipt 

11 

dpt 

12 

13 

dpt 

14  (b) 

Total 

180 

360 

Level  3 
Problems 


10 
20 
20 
10 
10 
10 
10 
ipt 
dpt 


90 


Daily 
Total 

60 
30 
80 
100 
90 
80 
70 
50 
40 
10 
10 
10 


630 


Item  Repetitions  to 
Total  Items  in  the  Pool 


Number  of 
Sessions 


Classify 

IncDec 

Problems 


180:60 
360:120 
90:30 


3.0 
3.0 
3.0 


7 
7 
7 


ipt  =  immediate  posttest 
dpt  =  delayed  posttest 


(a)  This  paradigm  is  one  session  longer  than  that  of  the 
other  treatment  groups  since  the  next  session  delayed  group 
must  come  in  for  feedback  one  day  after  they  complete  the 
exercises.     Thus,   their  immediate  posttest  on  the  problems  is 
given  one  day  later  than  the  other  groups. 

(b)  This  session  will  be  one  week  after  the  prior  session. 
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Table  3 


ANOVA  of  Treatment  Group  by  Low  and  High  Quartiles  on  Written 
Pretest  Scores  for  Low  Cognitive  Level  Task 


Mean 


Source 

df 

Squ 

are 

F 

P 

Main  Effects 

3 

47 

.65 

.839 

.479 

Group 

2 

34 

.72 

.612 

.547 

Posttest 

1 

72 

.59 

1, 

.279 

.264 

Interactions 

Grp  X  Posttest 

2 

181 

.76 

3, 

.202 

.050* 

Explained 

5 

101 

.30 

1, 

.784 

.134 

Residual 

48 

56 

.77 

Total 

53 

60 

.97 

*  p  <  .05 


Table  4 

ANOVA  of  Treatment  Group  by  Low  and  High  Quartiles  on  Written 
Pretest  Scores  for  High  Cognitive  Level  Task 


Mean 


Source 

df 

Square 

F 

P 

Main  Effects 

3 

184 

.69 

1. 

.331 

.275 

Group 

2 

277 

.02 

.  1. 

.997 

.147 

Posttest 

1 

5 

.93 

0. 

.043 

.837 

Interactions 

Grp  X  Posttest 

2 

1478 

.15 

10. 

.653 

.001** 

Explained 

5 

702 

.07 

5. 

.060 

.001 

Residual 

48 

138 

.75 

Total 

53 

191 

.89 

p  <  .01 
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THE  EFFECTS  OF  FEEDBACK,  CORRECTNESS  OF  RESPONSE,  AND 
RESPONSE  CONFIDENCE  ON  LEARNER'S  RETENTION  IN 
COMPUTER-ASSISTED  INSTRUCTION 


The  role  of  microcomputer  technology  in  the  educational  process  is  of  an  increasing  interest  among 
educators.  In  educational  computing,  computer-assisted  instruction  (CAI)  is  seen  by  many  educational  leaders 
^  a  cost-efficient  and  effective  method  of  instruction  (Nelson,  1985-86).  Clark  (1983)  states  that  the  novelty 
of  CAI  motivates  student's  learning.  The  novelty  effect,  however,  usually  wears  off  after  a  few  weeks. 
Waldrop  (1984)  suggests  that  instructional  designers  cannot  rely  solely  on  the  computer  as  a  prime  source  of 
reinforcement  Rather,  the  source  of  reinforcement  should  come  from  the  content  and  structure  of  CAI 
through  the  systematic  application  of  sound  principles  of  learning. 

One  important  element  in  the  design  of  computer-assisted  instruction  is  feedback.  The  ability  to 
give  appropriate  and  timely  feedback  has  often  been  cited  as  an  advantage  of  CAI  (Magidson,  1977;  Dence, 
1980).  Because  of  tlie  increasing  demand  for  quality  CAI,  there  is  a  need  to  investigate  the  effects  of  feedback 
within  the  context  of  CAI  (Carter,  1984). 

Although  it  has  been  widely  accepted  among  educators  that  feedback  facilitates  learning  in  many 
teaching  situations,  no  decisive  agreement  has  been  made  regarding  how  feedback  acts  to  promote  learning  and 
retention.  According  to  operant  psychologists,  feedback  following  a  correct  response  reinforces  and  thus 
increases  the  probability  that  the  response  will  be  made  again  in  the  future  (Bigge,  1982).  However,  research 
has  indicated  that  feedback  operates  primarily  to  coniect  errors  rather  to  reinforce  correct  response  as  claimed  by 
operant  psychologists  (Guthrie,  1971;  Anderson,  Kulhavy,  &  Andre,  1972;  Roper,  1977,  Bardwell,  1981). 

Most  of  the  studies  in  the  area  of  instructional  feedback  have  been  conducted  to  investigate  the  effects 
of  different  types  of  feedback  on  learning.  Few  attempts,  however,  have  been  made  to  consider  the  effects  of 
adapting  the  feedback  strategy  to  match  a  learner's  specific  needs  at  the  moment  of  learning.  Traditionally, 
feedback  is  piOvided  to  the  learner  based  on  the  correctness  of  his  response;  and  the  same  type  of  feedback  is 
given  to  the  learner  throughout  the  lesson  regardless  of  his  response.  Some  educators  suggest,  however,  that 
in  self-instructional  material,  feedback  that  is  provided  to  the  learner  should  be  "specific"  to  the  performance 
being  made  (Smith  &  Smith,  1966;  Caldwell,  1980). 

Feedback  research  has  suggested  that  the  learner's  response  confidence  affects  the  way  in  which  he 
uses  feedback  information  (Kulhavy,  Yekovich  &  Dyer,  1976;  1979).  Kulhavy,  et  al.  (1976)  conducted  a 
study  to  investigate  the  relationship  between  feedback,  confidence,  and  postresponse  behavior.  It  was  found 
that  feedback  study  times  were  shortest  for  correct  responses  with  high  confidence,  longest  for  incorrect 
responses  with  high  confidence,  and  somewhere  in  between  for  responses  with  low  confidence.  Responses 
with  high  confidence  were  remembered  more  accurately  on  the  tests  regardless  of  the  correctness  of  tht; 
responses.  No  major  differences  were  found  between  the  two  groups  regarding  responses  with  low  confidence. 
From  the  results  of  the  study,  Kulhavy  (1977)  suggested  that  the  interaction  between  feedback  and  learner 
expectation  in  terms  of  his  or  her  response  confidence  could  provide  a  powerful  effect  on  learner's  retention. 
He  also  suggested  that  the  learner's  confidence  in  the  response  might  be  used  as  a  basis  for  an  effective  design 
strategy  for  providing  feedback,  especially  when  the  instruction  was  under  the  control  of  computer. 

Based  on  the  results  of  the  study  conducted  by  Kulhavy,  et  al.  (1976),  knowledge  of  learner's 
response  confidence  and  correctness  of  response  may  be  used  in  identifying  the  type  of  feedback  which  will  be 
appropriate  to  the  learner's  postresponse  behavior.  Tlie  model  in  figure  1  represents  a  hypothetical  framework 
for  presenting  feedback  in  CAI  lesson.  Tliere  are  four  possible  conditions  for  each  response. 

I)  Correct  Response  with  High  Confidence 

For  this  condition,  only  the  knowledge  of  results  (KOR)  feedback  ("Correct")  will  be  needed  for 
providing  confirmation  of  the  correct  answer.  Additional  information  is  not  necessary  since  the  learner 
answered  correctly  and  had  confidence  in  the  answer. 

2^  Correct  Response  with  Low  Confidence 

Under  this  condition,  telling  the  learner  that  his  or  her  response  was  cokTect  may  not  be  sufficient. 
Additional  information  in  the  feedback  message  would  seem  to  be  needed  to  increase  the  level  of  confidence. 
Consequently,  the  knowledge  of  results  and  positive  response-contingent  feedback  (a  statement  of  why  the 
response  is  correct)  would  be  given  to  the  learner. 


2 


CORRECT 


ERROR 


KOR 
Feedback 


KOR  + 
Positive 
Response-Contingent 
Feedback 


KOR  + 
Negative 
Response-Contingent  + 
KCR  + 
Positive 
Response-Contingent 
Feedback 


KOR  + 
KCR  + 
Positive 
Response-Contingent 
Feedback 


Figure  1 

Hypothetical  Design  Model  for  Providing  Feedback  in  a  CAI  lesson 
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3>  Incorrect  R^^ponfte  with  High  Confidence 

For  this  condition,  additional  feedback  information  will  be  necessary  to  correct  error  response.  As 
suggested  by  Echtemacht,  Boldt  and  Sellman  (1971),  the  learner  should  first  be  shown  why  the  alternative 
selected  was  incorrect;  and,  after  he  or  she  is  convinced  of  the  error,  be  shown  why  the  keyed  answer  is,  in 
fact,  correct.  Consequently,  for  this  condition,  the  learner  will  be  given  knowledge  of  the  results,  plus 
negative  response  contingent  feedback  (a  statement  of  why  the  response  is  incorrect),  plus  knowledge  of  the 
correct  response  (feedback  of  correct  choice),  plus  positive  response-contingent  feedback  (a  statement  of  why 
the  keyed  answer  is  correct). 

4)  Incorrect  Response  with  T  .ow  Confidence 

For  this  condition,  the  learner  should  be  shov^  why  the  correct  answer  is  correct  (Echtemacht,  Boldt, 
&  Sellman;  1971).  Thus  the  learner  will  be  given  knowledge  of  results  (** incorrect"),  plus  knowledge  of 
correct  response  (feedback  of  correct  choice),  plus  positive  response-contingent  feedback  (a  statement  of  why 
the  keyed  answer  is  correct). 

Purpose  of  the  Study 

The  purpose  of  this  study  is  to  examine  within  the  context  of  CAT,  the  effects  of  feedback, 
correctness  of  response,  and  response  confidence  on  learner's  retention  of  verbal  information.  The  model  in 
Figure  1  was  used  as  a  design  strategy  for  providing  feedback  in  this  study. 

Specifically,  the  questions  investigated  in  this  study  are: 

1 .  Does  feedback  which  is  based  both  on  the  correctness  of  response  and  learner's  confidence  help  to 
promote  student's  retention  of  learned  material? 

2.  Does  feedbxk  following  a  correct  response  serve  to  ensure  that  a  correct  response  will  be  made  on 
a  later  test? 

3.  Does  feedback  following  an  incorrect  response  serve  :o  correct  the  mistake  and  ensure  that  a 
correct  response  will  be  made  on  a  later  test? 

4.  Do  different  levels  of  confidence  interact  with  feedback  following  a  correct  response  which  may 
serve  to  ensure  that  a  correct  response  will  be  made  on  a  later  test? 

5.  Do  different  levels  of  confidence  interact  with  feedback  following  an  incorrect  response  which 
may  serve  to  correct  mistake  and  ensure  that  a  correct  re.sponse  will  be  made  on  a  later  test? 

It  was  expected  on  both  immediate  and  delayed  posttests  that  the  feedback  group  would  perform 
significantly  better  than  the  no  feedback  group  with  respect  to  the  following  dependent  variables: 

1.  overall  correct  responses 

2.  conditional  probability  of  a  correct  response  on  a  test  given  that  a  correct  response  was  made  on 
the  lesson  P(RtlRi) 

3.  conditional  probability  of  a  correct  response  on  a  test  given  that  an  incorrect  response  was  made 
on  the  lesson  -  P(Rt|Wj) 

4.  conditional  probability  of  a  correct  response  on  a  test  given  that  a  high-confidence  correct 
response  was  made  on  the  lesson  -  P(RJRHi) 

5.  conditional  probability  of  a  correct  response  on  a  test  given  that  a  low-confidence  correct  response 
was  made  on  the  lesson  -  P(RJRLj) 

6.  conditional  probability  of  a  correct  response  on  a  test  given  that  a  high-confidence  incorrect 
response  was  made  on  the  lesson  -  P(RJWHj) 

7.  conditional  probability  of  a  correct  response  on  a  test  given  that  a  low-confidence  incorrect 
response  was  made  on  the  lesson  -  P(RJWL|) 

Method 

Subjects 

One  hundred  and  twenty-three  students  enrolled  in  four  Computer  Literacy  classes  at  the  University  of 
Texas  volunteered  to  serve  as  subjects  for  the  study.  Due  to  some  errors  in  recording  data  onto  the  diskettes, 
only  one  hundred  and  twenty  subjects  successfully  completed  the  experiment.  The  majority  of  tlie  subjects 
were  upper  division  education  students. 
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Materials 


The  instructional  material  for  this  study  was  **The  Structure  and  Function  of  the  Human  Eye" 
published  in  the  book  entitled  "Programmed  Instruction:  Techniques  and  Trends  (ODay,  Kulhavy,  Anderson 
&  Malczynski;  1971).  This  experimental  material  was  also  used  in  the  study  conducted  by  Kulhavy,  et  aL 
(1976).  There  are  thirty  program  frames  with  tliree  alternative  multiple-choice  questions  relating  to  the 
content  of  the  lesson.  Additionally,  there  are  six  text-related  drawings  for  use  at  designated  points  within  the 
lesson.  The  type  of  instructional  task  was  the  recall  of  verbal  information. 

Feedhar1cMes<;age5:.  Since  different  types  of  feedback  message  were  to  be  provided  to  subjects,  based 
upon  the  correctness  of  response  and  response  confidence,  the  feedback  messages  for  each  alternative  on  each 
question  were  written  by  the  researcher.  These  feedback  messages  were  evaluated  and  criticized  by  two  doctoral 
students  in  the  department  of  Science  Education  at  the  University  of  Texas  at  Austin. 

A  sample  frame  and  question  in  the  program  published  in  the  book  entitled  "Programmed  Instruction: 
Techniques  and  Trends  (ODay,  Kulhavy,  Anderson  &  Malczynski;  1971)  are  as  follows: 

The  rods  adapt  to  dimmer  light  conditions  by  means  of  a  visual  pigment  they  contain. .  •  called 
rhodopsin.  Rhodopsin  is  often  called  visual  purple  because  of  its  characteristic  dark  blue  color. 
The  raw  material  from  which  rhodopsin  is  made  is  vitamin  A,  and,  thus,  a  deficiency  of  vitamin 
A  will  result  in  poor  dim-light  vision. 

Which  of  the  following  statements  regarding  rhodopsin  is  true? 

(1)  It  contains  a  pigment  called  visual  purple. 

(2)  It  becomes  deficient  in  the  presence  of  vitamin  A. 

(3)  It  is  dark  blue  in  color,  (p.  163) 

The  following  is  an  example  of  feedback  message  for  the  instructional  frame  presented  above* 
Selected  Level  of  Feedback  Mef^f^age 

Answer  ConOdfiac^ 

1  High  Incorrect 


2 


3 
3 


2 


1 


High 
Low 


Low 


High 


Low 


Rhodopsin  does  not  contain  visual  purple.  Rhodopsin  is  often 
called  visual  purple. 
The  correct  answer  is  "3". 

Rhodopsin  is  often  called  visual  purple  because  of  its  characteristic 

dark  blue  color. 

Incorrect 

The  correct  answer  is  "3". 

Rhodopsin  is  often  called  visual  purple  because  of  its  characteristic 

dark  blue  color. 

InconecL 

Rhodopsin  is  made  from  vitamin  A.  Rhodopsin  becomes  deficient 
in  the  absence  of  vitamin  A. 
The  correct  answer  is  "3". 

Rhodopsin  is  often  called  visual  purple  because  of  its  characteristic 

dark  blue  color. 

Incorrect 

The  correct  answer  is  "3". 

Rhodopsin  is  often  called  visual  purple  because  of  its  characteristic 

dark  blue  color. 

Correct 

Correct 

Rhodopsin  is  often  called  visual  purple  because  of  its  characteristic 
dark  blue  color. 
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Lesson  n<*vi>inpment.  The  programming  language  used  in  the  development  of  the  CM  lesson  for 
this  study  was  SuperPILOT  authoring  language.  Two  computer  programs  were  developed  in  order  to  present 
the  material.  One  program  was  for  the  no  feedback  condition,  the  other  was  for  the  feedback  condition.  For 
each  frame  of  instruction  on  the  lesson  foi  the  no  feedback  condition,  the  computer  displayed  the  text  screen, 
recorded  the  time  the  subject  spent  on  reading  text,  displayed  the  question  screen,  recorded  the  response  and  the 
response  time,  and  recorded  the  confidence  in  the  response.  Additionally,  the  program  for  the  feedback 
condition  displayed  the  feedback  message  based  on  the  correctness  of  the  response  and  the  subject's  resporse 
confidence.  It  also  recorded  the  time  that  a  subject  spent  on  studying  the  feedback  message  for  each  frame. 
All  data  for  each  subject  were  stored  in  the  data  file  on  the  diskette.  Time  was  recorded  in  numbers  of  seconds. 
Since  it  took  a  few  seconds  for  the  computer  to  complete  filling  all  the  text  onto  the  screen,  and  since  the 
timer  started  after  the  last  line  of  text  displayed,  the  times  measured  were  approximations  and  should  be  used 
as  relative  rather  than  absolute  measures. 

Assessment  Instruments.  Both  immediate  and  delayed  retention  measures  consisted  of  the  same  thirty 
questions  seen  in  the  CAI  lesson.  However,  on  both  tests  the  sequence  of  these  questions  was  randomized. 
Posttests  were  paper-and-pencil  type  tests.  On  these  retention  tests,  subjects  were  not  asked  for  response 
confidence. 


The  experiment  was  conducted  during  a  regularly  scheduled  class  period  in  a  computer  classroom 
equipped  with  41  Apple  II  computers.  All  students  in  a  given  class  were  randomly  assigned  to  either  the  no 
feedback  or  the  feedback  condition.  At  the  beginning  of  the  class,  the  request  for  volunteers  was  made  by  the 
class  instructor.  All  students  were  informed  that  their  regular  class  giade  would  not  be  affected  by  their 
performance  on  the  experiment.  They  were  also  told  that  they  were  not  required  to  participate  in  the  study. 
However,  they -would  have  had  to  do  an  alternative  assignment  during  the  class  had  they  chosen  not  to 
participate.  All  students  attending  the  class  on  the  days  of  the  experiment  volunteered  to  be  part  of  the  study. 

Each  subject  was  given  the  six  drawings  to  be  used  with  the  CAI  lesson.  At  the  beginning  of  the 
lesson,  they  were  asked  to  type  their  names.  Then  they  were  informed  of  what  they  could  expect  from  the 
lesson.  They  were  initially  toJd  that  there  were  thirty  frames  of  instruction  in  aie  lesson.  Each  frame 
consisted  of  one  screen  of  text  imd  one  screen  of  question  rcrsUng  to  the  content  of  the  text.  They  were 
instructed  to  press  the  "Return"  kcty  when  they  finished  reading  the  text  screen.  They  would  then  see  a  screen 
displaying  a  multiple-choice  question  and  were  asked  to  enu  r  their  response  to  that  question  by  pressing  a 
number  of  their  choice  from  I  to  3.  Tlie  computer  would,  at  this  point,  ask  them  to  enter  their  confidence  in 
the  choice  they  just  made.  They  were  instructed  to  enter  which  represented  "low  confidence"  if  they  were 
not  luite  sure  that  their  aitswer  ms  a  correct  oae.  If  tliey  felt  positive  that  their  answer  was  correct,  they  were 
inauiicted  to  enter  a  *^2"  which  represented  "high  confidence".  For  the  subjects  in  the  no  feedback  condition, 
they  were  lold  that  after  they,  entered  the  number  signifying  the  a-  degree  of  confidence  in  the  answer,  they 
woulu  receive  a  new  Trame  of  instruction.  5ubjeciS  in  the  feedback  group  were  also  told  that  they  would  be 
given  a  mesrage  regarding  their  answer  to  question  asked,  and  that  they  had  to  press  the  "Return"  key  after 
they  finished  reading  the  message. 

*  ;pon  the  completion  of  the  CAI  lesj  jn,  the  diskette  and  the  irawings  were  collected  by  the 
researcher,  anc'.the  immediate  positest  was  administered.  One  week  after  the  experimental  session,  the  delayed 
posttest  was  given  to  the  subjects  during  the  regularly  scheduled  class  period.  Since  seventeen  subjects  did 
not  attend  the  classes  on  the  days  of  the  delayed  posttest  administration,  only  one  hundred  and  three  subjects 
took  the  delayed  test.  As  noted  by  Borg  and  Gall  (1983),  sampling  bias  may  be  expected  in  studies  reporting 
large  losses  of  subjects,  for  the  subjects  who  remain  with  the  study  until  its  completion  may  be  different  from 
those  who  drop  out  For  both  those  who  did  and  did  not  take  the  delayed  posttest,  analysis  of  variance  was 
performed  on  the  items  answered  correctly  within  the  CAI  lesson.  This  was  performed  to  determine  whether 
this  study  was  subjected  to  sampling  bias.  The  result  indicated  that  there  was  no  significant  difference  between 
the  subjects  who  took  the  test  and  those  who  did  not  (F  =  2.1429 ,  p  «  .1459). 

With  respect  to  procedures,  the  differences  between  the  study  conducted  by  Kulhavy  et  al.  (1976)  and 
this  study  are  as  follows: 

nporm  ofTnctnirrinn 

In  the  study  by  Kulhavy  et  al.  (1976),  the  instruction  was  in  the  form  of  programmed  instruction. 
The  text  and  its  question  were  on  the  same  page.  The  subjects  could ,  ifer  back  to  the  text  while  tliey  were 
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answering  the  question.  In  this  study,  the  instruction  was  in  the  form  of  computer-assisted  instruction.  The 
text  and  its  question  were  on  separate  screens.  After  the  subjects  turned  to  the  question  screen,  they  could  not 
go  back  to  the  previous  text  screen. 
2^  Feedbaclc  Procedure 

In  the  study  by  Kulhavy  et  al.  (1976),  the  subjects  in  the  feedback  condition  received  Knowledge  of 
Correct  Response  (KCR)  feedback  by  erasing  opaque  circles  on  the  response  card  until  they  located  the  correct 
choice  for  the  particular  question.  In  this  study,  the  subjects  in  the  feedback  condition  received  different 
feedback  messages  based  upon  the  correctness  of  their  response  and  their  confidence  in  the  response. 

3^  Rating  of  ronfidence 

The  subjects  in  the  study  by  Kulhavy  et  al.  (1976)  rated  their  confidence  on  a  scale  of  five,  whereas 
the  subjects  in  this  study  recorded  their  confidence  on  a  scale  of  two  (high  or  low). 

Design 

The  design  of  this  study  was  a  posttest  only  control  group  design.  The  design  was  represented  by  the 
following  diagram: 

R     Oi    X    02  O3 
,      R     Oi         O2  O3 
where  R  »  random  assignment 

X  »  experimental  treatment  (feedback) 
0}  »  practice  items  on  the  lesson 
02"  immediate  posttest 
03-  delayed  posttest 

Data  Analysis 

All  statistical  analyses  were  performed  by  using  SPSS^(1986)  on  an  IBM  3081  computer  at  the 
University  of  Texas  at  Austin. 

Ana1v?;k  of  Overall  rnrrect  Responses,  In  order  to  determine  the  effects  of  feedback  which  was 
provided  on  the  basis  of  correctness  of  response  and  response  confidence,  one-way  analysis  of  variance  was 
performed  on  the  overall  correct  responses  for  the  feedback  and  no  feedback  groups  on  each  posttest 

Analysis  of  Conditional  Probabilities.  Following  the  procedure  used  by  Kulhavy  et  al.  (1976), 
conditional  probabilities  relating  lesson  performance  to  the  immediate  and  delayed  posttests  were  calculated  to 
determine  the  effects  that  feedback  following  a  correct  response  had  on  both  posttests.  The  conditional 
probability  of  a  correct  response  on  the  test  given  that  a  correct  response  was  made  on  the  lesson,  P(RilRi),  is 
the  proportion  consisting  of  the  number  of  responses  which  were  correct  on  the  test  and  were  also  correct  on 
the  lesson  (RtnRj),  divided  by  the  total  number  of  responses  which  were  correct  on  the  lesson  (Ri).  This 
conditional  probability  was  also  calculated  for  high  and  low  confidence  correct  responses  on  the  lesson. 

To  determine  the  effects  that  feedback  following  an  incorrect  response  had  on  immediate  and  delayed 
retentions,  conditional  probabilities  relating  lesson  performance  to  the  two  posttests  were  calculated.  The 
conditionai'probability  of  a  correct  response  on  the  test  given  that  an  incorrect  response  was  made  on  the 
lesson,  P(RJWj),  is  the  proportion  consisting  of  the  number  of  responses  which  were  correct  on  the  test  and 
were  incorrect  on  the  lesson  (Rt  n  Wj),  divided  by  the  total  number  of  responses  which  were  incorrect  on  the 
lesson  (W|).  This  conditional  probability  was  also  calculated  for  high  and  low  confidence  correct  responses  on 
the  lesson.  Since  the  resulting  conditional  probability  data  were  proportional  data,  they  had  to  be  transformed 
by  using  the  arc  sine  function  (Dowdy  &  Wearden,  1983).  To  test  for  statistical  difference  between  the 
feedback  conditions,  a  multivariate  analysis  of  variance  was  performed  on  the  transformed  conditional 
probability  data  for  each  posttest. 

Results 

Overall  Correct  Responses 

Table  1  shows  the  n  ''ans  and  standard  deviations  for  overall  correct  responses  on  the  posttests. 
When  the  means  on  the  immea.ate  posttest  were  compared  using  a  one-way  analysis  of  variance,  a  statistical 
significant  difference  was  found  between  the  feedback  conditions,  F  (1,118)  =  17.81,  p  <  .001,  with  those 
who  receiving  feedback  performing  significantly  better  than  the  no  feedback  group.  When  the  means  on  the 

140 

147 


7 


delayed  positest  were  ccMnpared,  no  significant  difference  was  found  between  the  feedback  conditions,  F  (1, 101) 

In  order  to  determine  if  there  were  significant  differences  between  the  feedback  conditions  regarding 
the  performance  on  lesson,  a  one-way  analysis  of  variance  was  calculated  on  the  mean  of  three  variables: 
number  of  correct  responses  on  the  lesson,  text  reading  time,  and  response  time.  No  significant  differences 
were  found  on  the  analyses  of  the  number  of  correct  response  and  the  response  time.  A  significant  difference 
was  found  between  the  feedback  conditions  with  respect  to  the  variable  text  reading  time.  The  no  feedback 
group  spent  significantly  more  time  reading  text  frame  than  the  feedback  group,  F  (1,1 18) »  9.91,  p  <  .OL 


'  Table  1 

Means  and  Standard  Deviations  for  Correct  Responses  on  Posttests 


Test  Position 

Feedbacic  Condition 

Absent 

Present 

Immediate 

M 

22.08 

24.97 

SD 

4.34 

3.02 

Delay 

M 

19.50 

20.48 

SD 

4.89 

5.11 

Conditional  Probability  Measures 

From  the  multivariate  analysis  of  variance  (MANOVA)  performed  on  the  means  of  the  six 
transformed  conditional  probabilities  on  the  immediate  positest,  a  significant  difference  was  found  between  the 
feedback  conditions  (Wilks*  lambda  «  .39321,  F  -  22.37550,  Sig.  of  F  <  .001).  Table  2  presents  the 
univariate  F*tests  on  the  conditional  probabilities. 


Table  2 

Analysis  of  Conditional  Probability  Measures  on  the  Immediate  Positest 


Variable 

Group 

N 

Mean 

Transformed  Mean 

SD 

F 

Sig.  of  F 

NFB 

46 

0.83 

1.01 

0.22 

P(RtlRi) 

1.56 

0.22 

FB 

48 

0.85 

1.07 

0.23 

NFB 

46 

0.86 

1.10 

0.25 

P(RilRHi) 

0.00 

0.99 

FB 

48 

0.87 

1.10 

0.22 

NFB 

46 

0.72 

0.93 

0.46 

P(RtlRLi) 

1.85 

0.18 

FB 

48 

0.79 

1.06 

0.45 

NFB 

46 

0.25 

0.25 

0.18 

P(Ri|Wi)  ■ 

130.24 

0.00 

FB 

48 

0.74 

0.90 

0.34 

NFB 

46 

0.22 

0.26 

0.36 

P(RilWHi) 

79.16 

0.00 

FB 

48 

0.77 

1.05 

0.49 

'ti?B 

46 

0.25 

0.29 

0.36 

P(RilWLi) 

49.47 

0.00 

FB 

48 

0.70 

0.90 

0.47 

o 
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The  result  of  MANOVA  pcrfonned  on  the  means  of  the  six  transformed  conditional  probabilities  on 
the  delayed  posttest  also  indicated  a  significant  difference  between  the  feedback  conditions  (Wilks*  lambda  » 
.62392,  F«  7.43408,  Sig,  of  F  <  .001).  The  results  of  the  univariate  F-tests  were  presented  in  Table  3. 


Table  3 

Analysis  of  Conditional  Probability  Measures  on  the  Delayed  Posttest 


Variable 

Group 

N 

Mesn 

Tninsformed  Mean 

SD 

F 

Sip  of  F 

P(RtlRi) 

NFB 

40 

0.68 

0.77 

0.19 

0.01 

0.94 

FB 

41 

0.68 

0.77 

0  19 

NFB 

40 

0.71 

0.82 

P(RtlRHi) 

0.65 

0.42 

FB 

41 

0.69 

0.78 

0.21 

NFB 

40 

0.60 

0.72 

0.42 

P(RtlRLi) 

0.09 

0.77 

FB 

41 

0.62 

0.75 

0.43 

NFB 

40 

0.34 

0.35 

0.20 

P(RilW,) 

40.58 

0.00 

FB 

41 

0.60 

0.67 

0.25 

NFB 

40 

0.39 

0.48 

0.47 

P(RilWHi) 

9.88 

0.00 

FB 

41 

0.64 

0.80 

0.46 

NFB 

40 

0.26 

0.28 

0.27 

P(RtlWLi) 

18.89 

0.00 

FB 

41 

0.53 

0.64 

0.45 

The  results  regarding  the  probability  of  correct  ^onse  on  the  test  given  that  a  correct  response 
was  made  on  the  lesson,  PCR^IRj)  on  both  the  immediate  and  delayed  posttests  indicated  no  significant 
difference  between  the  fecdbacic  conditions.  When  the  correct  responses  on  the  both  posttests  were  analyzed 
further  on  the  basis  of  learner's  confidence  in  the  response  made  on  the  lesson,  no  significant  differences  were 
found  between  the  groups  concerning  the  probability  of  correct  response  on  the  test  given  that  a  correct 
response  with  high  confidencii  was  made  on  the  lesson,  P(Ri|RHi).  The  same  results  were  found  on  both 
posttests  for  the  probability  of  correct  response  on  the  test  given  that  a  correct  response  with  low 
confidence  was  made  on  the  lesson,  P(RJRLi). 

The  result^  on  both  immediate  and  delayed  posttests  indicated  that  there  was  a  significant  difference 
between  the  no  feedback  and  feedbaclc  groups  (p  <  .001)  regarding  the  probability  of  correct  response  on  the 
test  given  that  an  incorrect  response  was  made  on  the  lesson,  P(Rj|Wj,.  When  the  correct  responses  on  the 
test  were  analyzed  further  on  the  basis  of  learner's  confidence  in  the  response  made  on  the  lesson,  it  was  found 
that  there  was  significant  difference  between  the  two  groups  (p  <  .001)  regarding  the  probability  of  correct 
response  on  the  tesl  Jvtn  that  a  high  confidence  incorrect  response  was  made  on  the  lesson,  P(RJWHj). 
For  the  probability  of  correct  response  on  the  test  given  that  a  low  confidence  incorrect  response  was  made 
on  the  lesson,  P(R^|WLj),  a  significant  difference  was  also  found  between  the  feedback  and  no  feedback  group 
(p  <  .001). 

Discussion 

Overall  Correct  Responses  on  Posttests 

With  respect  to  the  overall  correct  responses  on  the  immediate  posttest,  the  fet*dback  group  performed 
significantly  better  than  the  no  feedback  group.  However,  no  significant  difference  was  found  on  the  delayed 
posttest.  The  findings  indicate  that  feedback  helps  to  promote  the  subject's  retention  of  learned  material  at 
least  on  the  immediate  retention. 
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The  overall  correct  responses,  then,  were  analyzed  further  to  examine  how  feedback  helps  to  increase 
the  correct  responses  on  the  posttest  by  focusing  on  the  effects  of  feedback  following  correct  and  incorrect 
responses  on  the  lesson. 

Feedback  Following  Correct  Responses 

It  was  hypothesized  that  providing  feedback  after  correct  responses  would  confirm  the  subjects  that 
their  understanding  of  the  material  was  accurate  and  thus  ensure  that  the  same  correct  responses  would  He  made 
on  a  later  test.  The  analyses  on  both  immtilu^  and  delayed  posttests  regarding  the  conditicnal  probability  of 
a  correct  response  on  the  immediate  posttest  given  that  a  correct  response  was  made  on  the  lesson  did  not 
support  the  above  hypothesis.  This  result  is  similar  to  the  result  found  in  Gutbrie*s  study  (1971).  Guthrie 
also  found  that  providing  feedback  after  a  correct  response  did  not  increase  the  probability  that  the  correct 
response  would  also  be  correct  on  a  later  tesL  Howevert  a  contradicting  result  was  found  in  the  study 
conducted  by  Kulhavy  et  «1.  (1976).  In  their  study,  it  was  founG  that  the  subjects  who  received  feedback  after 
a  correct  response  were  more  likely  to  remember  their  correct  responses  on  a  s  ubsequent  test 

When  the  level  of  Ieanier*s  confldence  in  the  response  was  taken  into  account  the  results  of  the 
present  study  indicate  that  knowledge  of  results  (KOR)  feedback  provided  for  a  high-confidenc&  correct 
reS;;onse  on  the  lesson  does  not  increase  the  probability  tliat  the  answer  would  be  correct  ^gain  on  the 
posttests.  The  findings  also  contradict  the  findings  in  ^  tudy  by  Kulhavy  et  al.  (1976).  tor  a  low* 
confidence  corrca  response,  it  was  hypothesized  that  the  \  t  response-contingent  feedback  (a  sutement  of 
why  the  response  is  correct)  in  addition  to  KOR  wouiu  .^Ip  the  acquisition  of  materia^  increase  their 
confidence,  and  thus  promote  the  retention  cf  the  learned  material.  The  results  of  the  study  also  fail  to 
support  this  hypothesis. 

The  findings  of  the  study  regarding  the  eff:.*cts  of  feedback  following  correct  responses  indicate  that 
regardless  of  confidence  in  the  response  feedback  dees  not  help  to  increase  the  probability  that  a  correct 
response  will  also  be  correct  on  a  later  test  One  possible  c^^pianation  for  the  results  is  probably  due  to 
attention  effect  Attention  plays  an  important  role  h  learning  from  written  materials  (Anderson,  1970).  It 
was  found  in  this  prtsent  study  that  the  subjects  in  the  no  feedback  group  spent  significantly  more  time 
reading  text  frame  than  those  in  the  feedback  group.  Since  the  5.ubject$  in  the  no  feedback  did  not  receive 
additional  help  from  feedback,  they  probably  spent  more  time  and  effort  in  order  to  comprehend  the  material 
before  they  turned  to  the  question.  Research  about  the  effect  of  comprehension  depth  and  memory  suggests 
that  deeper  comprehension  of  material  is  associated  with  better  retention  (Mistler-Lachman,,  1974).  The 
increased  attention  in  the  no  feedback  group  probably  attributed  tc  \bt  lack  of  significant  effects  of  feedback 
following  the  correct  response. 

Feedback  Following  Incorrect  Responses 

It  was  hypothesized  that  feedback  following  incorrect  responses  would  serve  to  correct  error  and 
ensure  that  a  correct  response  would  be  made  again  on  a  later  test  A  significant  difference  was  found  between 
the  feedback  conditions  regarding  the  conditional  probability  of  a  correct  response  on  the  each  posttest  given 
that  an  incorrect  response  was  made  in  the  lesson.  Therefore,  these  findings  suppon  the  hypothesis  that 
feedback  following  incorrect  responses  increases  the  probability  that  the  response  will  be  correct  on  a  later 
test.  Similar  results  were  also  found  in  the  study  conducted  by  Guthrie  (1971).  In  the  study  b^^  Kulhavy  et 
al.  (1976),  however,  no  significant  difference  was  found  between  the  feedback  and  no  feedback  group  with 
respect  to  this  conditional  probability.  The  difference  in  the  procedure  between  this  present  study  and 
Kulhav/s  study  may  account  for  the  difference  in  the  results.  In  Kulhavy's  study,  the  subjects  received 
knowledge  of  correct  response  (KCR)  feedback  and  they  could  refer  back  to  the  text  to  locate  their  error.  In  the 
present  study,  the  subjects  received  not  only  the  KCR  but  also  an  explanation  of  why  the  response  was  not 
correct 

When  the  level  of  learner's  confidence  in  the  response  was  taken  into  account,  a  significant  difference 
was  found  between  the  feedback  and  no  feedback  group  regarding  the  conditional  probability  of  a  correct 
response  on  each  posttest  given  that  a  high*confidence  incorrect  response  wai  made  on  the  lesson.  Tite  results 
indicated  that  feedback  following  a  high-confidence. incorrect  responses  helps  the  subject  to  correct  errors. 
Similar  results  were  also  found  in  the  study  conducted  by  Kulhavy  et  al.  (1976).  With  respect  to  the 
conditional  probability  of  a  correct  response  on  the  test  given  that  a  low-confidence  incorrect  response  was 
made  in  the  *esson,  a  significant  difference  was  also  fouiid  between  the  feedback  and  no  feedback  groups. 
Therefore,  fee-^Hack  following  a  low-confidence  incorrect  response  also  helps  to  correct  error.  However,  no 
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significant  difference  was  found  in  the  study  conducted  by  Kulhavy  et  al.  (1976).  Again  the  difference  between 
the  results  of  their  study  and  the  present  study  is  probably  due  to  the  differences  in  the  procedure  of  the  two 
studies.  Another  possible  explanation  might  be  the  difference  in  the  rating  scale  of  leamer^s  confidence  in  the 
response.  In  Kulhavy's  study,  the  subjects  rated  their  confidence  on  a  scale  of  5.  In  this  present  study,  the 
subjects  recorded  their  confidence  either  high  or  low. 

Overall,  the  findings  of  the  study  suggest  that  feedback  helps  to  promote  immediate  retention  of 
verbal  information.  Regardless  of  the  learner's  confidence  in  the  response,  feedback  follov/ing  an  incorrect 
response  had  significant  effects  on  both  immediate  and  delayed  retention  of  the  learned  material.  Wiih  respect 
to  the  function  of  feedback,  the  findings  of  this  study  seem  to  be  consistent  with  previous  feedback  research 
which  indicate  that  feedback  functions  as  a  guide  for  identifying  and  correcting  error. 

There  are  several  recommendations  for  future  research  suggested  by  the  finding  of  this  study.  Firet,  it 
will  be  interesting  to  see  whether  the  results  will  be  replicated  in  similar  studies  conducted  in  the  conditions 
as  closely  as  possible  to  the  actual  classroom  setting. 

^  Other  suggestions  for  further  research,  with  respect  to  the  experimental  design,  include  a  replication 
of  this  study  which  might  include  larger  sample  size  in  order  to  incorporate  more  treatment  groups  in  the 
experimental  design.  For  example,  the  design  of  this  present  study  can  be  extended  to  include  two  more 
feedback  groups:  a  group  that  will  receive  only  Knowledge  of  Results  (KOR)  feedback  regardless  of  the 
correctness  of  response  or  learner's  confidence,  and  another  group  that  will  receive  feedback  which  explains 
why  an  answer  is  correct  or  incorrect  Such  a  design  would  be  appropriate  in  determining  whether  the 
provision  of  feedback  information  on  the  basis  of  correctness  of  response  and  learner's  confidence  is  b^^tter  than 
simply  providing  the  same  type  of  feedback  to  learners.  Another  variation  in  terms  of  the  design  might  be  to 
examine  whether  offering  a  chance  for  the  learner  to  review  the  material  after  incorrect  response  and  correct  the 
mistake  by  himself  will  be  as  effective  as  providing  feedback  explaining  why  his  answer  is  incorrect. 

With  respect  to  data  analysis,  it  is  recommended  that  research  in  the  area  of  instructional  feedback 
should  include  the  conditional  probability  measure  in  th(j  analysis.  The  use  of  such  measure  allows  the 
researchers  to  examine  the  effects  of  feedback  following  correct  and  incorrect  response  separately. 

Finally,  future  research  is  needed  to  examine  the  effects  of  feedback  on  retention  across  different  types 
of  learning  outcomes.  The  learner's  need  of  feedback  information  for  one  type  of  learning  outcome  may  not 
be  the  same  for  another.  The  intended  learning  outcome  emphasized  in  this  study  was  verbal  information. 
Future  research  might  focus  on  the  effects  of  feedback,  correctness  of  response,  and  learner's  confidence  on 
retention  of  other  types  of  learning  outcomes  such  as  intellectual  skills  and  cognitive  strategies  as  designated 
byGagne(1977). 
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Instructional  Development  and  Teacher  Education 

Several  years  ago,  in  an  article  in  ECTJ,  Sharon  Shrock  (1985) 
described  her  research  on  teacher  attitudes  towrds  instructional 
development.  Shrock  explained  that  ignorance  of  such  attitudes  is 
one  reason  that  "in  spite  of  our  conviction  that  our  technology 
could  dramatically  improve  learning,  most  elementary,  secondary, 
and  college  instruction  proceeds  today  as  it  al^ys  has"  (p.  16). 
Shrock  Tfent  on  to  call  for  further  research  on  teacher  attitudes 
towards  instructional  development. 

Recently,  undergraduate  education,  including  undergraduate 
teacher  education,  has  been  a  primary  target  for  reformers.  This 
movement  to  reform  undergraduate  teacher  education  is  likely  to 
involve  instructional  development  faculty  working  in  university 
settings.  Without  an  understanding  of  teacher  educator's 
perceptions  about  instructional  development,  the  efforts  of 
instructional  developers  are  as  likely  to  create  ill-will  as 
improved  teacher  education  programs. 

In  this  study  faculty  beliefs  about  instructional  development 
and  .teacher  education  vere  investigated.    Nine  faculty  members 
participated  in  this  study,  all  of  whom  teach  in  the  school  of 
education  of  a  large  state  university.    These  respondents  included 
five  undergraduate  methods  teachers  and  four  instructional 
development  teachers.  This  semester-long  study  was  emergent  in 
design  and  was  conducted  primarily  through  interviews. 

Hethodology 

The  methodology  of  natti»;alistic  inquiry  was  used  in  this  study 
(Lincoln  and  Guba,  1985).    In  her  own  naturalistic  study  of  faculty 
perceptions  of  ID,  Shrock  (1985)  listed  the  follcwing  features  of  a 
naturalistic  methodology:  "Ihe  collecting  of  data  occurs  in  real 
world  settings  in  the  relative  absence  of  a  priori  assumptions. 
Datia  collection  and  amlysis  proceed  simultaneously  with  additional 
data  sources  pursued  on  the  basis  of  preliminary  results"  (p.  18). 

As  with  most  naturalistic  studies,  the  design  of  this  inquiry 
emerged  as  it  proceeded.    Emergent  design  follows  from  the 
mtiiralistic  assuoqption  that  individuals  construct  their  own 
realities  and  an  inquirer  is  unlikely  to  know  enough  about  the 
constructed  realities  of  others  to  be  able  to  design  a  study  a 
priori.    Ihe  inquirers  task  Is  to  make  sense  of  multiple  realities. 
The  unstructured  naturalistic  methodology  provides  the  inquirer  the 
opportunity  to  explore  diverse  and  coi^Jlex  realities  without  the 
limitations  of  a  predetermined  research  design. 

Hie  conclusions  of  this  study  are  traceable  back  to  the  data 
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sources  from  vbich  they  were  drawi.    Some  of  this  data  is  included 
as  Appendices  A,  B  and  C.    The  data  in  the  appendices  provides  to 
the  reader  with  the  opportum- ty  to  critically  consider  the 
methodology  and  conclusions  or  this  study. 

Naturalistic  inquiry,  liJce  experimental  research,  is  considered 
to  be  disciplined  inquiry.    Hie  means  used  to  provide  rigor  in 
naturalistic  inquiry  are,  however,  quite  different  than  the  means 
used  in  experimental  research.    In  naturalistic  inquiry  rigor  is 
siqjplied  through  such  means  as  prolonged  engagement  in  the  <:';udy, 
verifying  interview  notes  with  respondents,  keepjjog  a 
methodological  journal,  and  leaving  an  audit  trail  which  allows  the 
concliisions  of  the  study  to  be  traced  back  to  their  sources  in  the 
data.    In  this  study  interview  notes  were  given  to  respondents,  for 
correction  azid  verification,  a  journal  was  kept  of  my  thoughts  on 
the  study,  and  the  conclusions  are  traceable  to  the  notes  and 
documents  collected  during  this  study  (these  data  sources  have  been 
organised  and  bound  into  a  booklet  ^Jhich  is  approximately  200  pages 
long). 

Description  of  the  Study 

Li  this  section  I  present  a  description  of  the  major  events  of 
this  study.  Exerpts  from  some  of  the  docukents  discussed  in  this 
section  can  be  found  in  the  appendices. 

The  Initial  Question 

IMS  inquiry  began  with  my  interest  in  finding  out  lafliether  the 
principles  of  instructional  development  are  being  taught  to  teacher 
education  students.    In  my  original  research  proposal  I  explained 
my  purpose  in  these  words:  "Training  in  instructional  design, 
custom  fitted  to  the  needs  of  future  teachers,  would  bTpass  the 
political  resistance  of  older  teachers  and  administrators.  The 
next  generation  of  teachers  could  bring  more  effective  education 
through  the  front  doors  of  the  elementary  and  secondary  schools. 
But  how  much  instruction  in  the  basic  principles  of  instructional 
development  are  teacher s-in- training  receiving?" 

Very  early  in  the  study  the  emphasis  shifted  from  this  original 
question  to  the  problem  of  understanding  the  differences  between 
the  ways  methods  teachers  and  instructional  development  teachers 
think  about  teacher  education.    Uie  primary  reason  for  this  shift 
was  my  discovery  that  the  methods  teachers  I  was  interviewjjig 
appeared  to  think  much  more  like  instructional  developers  than  I 
had  previously  imagined. 

In-Depth  Interviews  with  Two  Hethods  Teachers 

Data  collecting  began  with  two  sets  of  interviews:  three 
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interviews  with  a  science  methods  teacher  and  the  three  interviews 
with  a  nath  methods  teacher.    These  respondents  were  chosen  because 
of  my  interest  in  science  and  math  education  and  because  I  was 
acquainted  with  these  particular  individuals.    In  introducing  this 
study  to  these  respondents  I  explained  that  my  purpose  was  to  find 
out  what  they  thought  was  ia^ortant  in  teacher  education.  (Exerpts 
from  the  notes  of  one  initial  interview  are  included  in  Appendix 
A.) 

In.  the  first  of  the  three  interviews  I  was  interested  in  letting 
each  respondent  tell  me,  in  an  unstructured  way,  what  he  thought 
was  iii^ortant  in  teacher  education,  with  particular  ei[q)hasis  on 
what  was  taught  in  his  own  methods  course.    Following  these  initial 
interviews  I  prepared   summaries  of  ^t  was  said.    In  the 
remaining  interviews  (two  with  each  respondent)  I  asked  the 
respondents  to  elaborate,  verify,  and  rank  these  important  items. 
(One  set  of  final  rankings  is  given  in  ^pendix  A. } 

As  this  phase  of  the  stiKiy  progressed  I  found  that  both  methods 
teachers  believed  that  systematically  designed  instruction  is 
important,  far  more  so  than  I  bad  expected.    Planning  with 
objectives,  formative  evaluation,  and  the  use  of  well-designed 
instructional  materials  were  all  ideas  that  were  central  in  their 
courses.    Learning  to  use  technological  devices  to  facilitate 
instruction,  especially  learning  to  use  the  coa^juter,  was  also 
consistently  mentioned  as  iiiportant. 

I  found  the  views  of  teacher  educators  on  technology  and 
systematically  designed  instruction  to  be  curiously  similiar  to  the 
views  held  by  some  instructional  developers.  I  realized  that  my 
choice  of  respondents  and  the  questions  I  had  asked  may  have 
contributed  to  this  finding.    The  next  phase  of  the  study  was 
designed  to  further  explore  the  differences  in  views  between 
teacher  educators  and  instructional  designers. 

Questionnaires  Sent  to  Facultv  Hembers 

In  the  second  phase  of  this  study  I  sent  questionnaires  to  seven 
methods  teachers  and  seven  instructional  development  teachers.  In 
this  brief  questionnaire  1  asked  faculty  members  two  questions: 
what  they  thoi^ht  teacher  education  students  should  learn  about 
using  technology  in  education  and  ^y  they  held  the  belief  they 
did. 

I  received  replies  from  three  methods  teachers  and  from  four 
instructional  development  teachers.    These  written  replies  are 
provided  in  i^pendix  B. 

Upon  analyzing  the  data  from  these  questionnaires  I  found  that 
the   variety  of  answers  among  groups  was  nearly  as  varied  as  the 
answers  within  grovips.    For  example,  in  both  groiqDS  there  were 
members  ^o  defined  technology  as  a  process  and  other  members  who 
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defined  teclmology  as  a  product.    In  both  groups  ^ere  members  \^ho 
TOre  very  positive  about  the  processes  of  instructional  technology 
and  meittbers  ^o  saw  limitations  to  an  education  ^ch  is  overly 
reliant  on  physical  technologies.    One  methods  teacher  vncote  that 
he  could  easily  see  the  coB^Juter  talcing  over  the  information 
providing  role  of  the  teacher  ^le  one  instructional  development 
teacher  wrote  that  teaching  is  child-centered  and  not 
technology-centered.    Based  on  my  limited  sample,  it  appeared  that 
methods  teachers  were  very  positive  about  the  role  of  .technolgical 
devices  (^'specially  the  computer)  as  a  means  to  present  and  manage 
instruction;  perhaps  more  so  than  instructional  development 
teachers: 

At  the  conclusion  of  this  second  phase  I  had  three  tentative 
conclusions,  all  of  which  sijgjrised  me:  a)  that  methods  teachers 
promote  instructional  development  processes  in  their  courses;  that 
methods  teachers  promote  the  use  of  technological  devices  among 
their  students;  and  that  methods  teachers  are  not  adverse  to  the 
idea,  that  some  of  the  roles  of  the  teacher  could  be  taken  over  by 
electronic  delivery  systems. 

I  felt  the  need  to  share  these  tentative  conclusions  ^xith 
facui,ty  liho  were  likely  to  dispute  them.    Accordingly,  I  arranged 
to  imtividually  interview  a  methods  teacher  (ref  ered  to  in  the 
appendices  as  Dr.  E)  who  was  known  for  his  humanistic  approach  to 
teacher  education,  and  an  instructional  development  teacher  (Dr.  Z) 
known  for  his  strong  stance  in  favor  of  instructional  technology  in 
education. 

Presenting  the  Findings  for  Critique 

In  the  third  and  final  phase  of  this  study  I  presented  these  two 
respondents  (Dr.  E  and  Dr.  Z)  with  my  preliminary  conclusions. 
(Exerpts  from  the  interview  summaries  are  given  in  Appendix  C. ) 

Dr.  E  told  me  he  was  not  si^rised  with  any  of  my  findings.  He 
said  that  most  teacher  educators  have  a  technocratic  and 
utilitarian  view  of  teaching  that  ei^hasizes  techniques.  Uethods 
teachers  are  not  themselves  based  in  any  intellectual  tradition  and 
do  not  attempt  to  make  future  teachers  thoughtful  about  education. 
He  ^id  that  he  believes  teachers  are  disenfranchised  and  deskiiled 
as  a  consequence  of  not  being  allowed  to  develop  their  own 
instruction.    Schools,  with  their  increasing  emphasis  on 
pre-packag«i  instructional  materials  and  testing,  are  aggravating 
this  problem. 

Dr.  Z  had  a  very  different  view  of  my  results.  He  believed  that 
my  conclusions  were  very  much  open  to  question.  First,  I  could  not 
be  certain  that  methods  teachers  were  really  teaching  instructional 
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developaent  concepts.    Tlieir  understanding  and  use  of  these 
concepts  may  be  very  different  than  what  I,  as  an  instructional 
developer,  would  expect.    Secondly,  I  had  posed  ay  questions  about 
technology  at  such  a  high  level  of  abstraction  that  the  answers 
given  by  methods  teachers  only  appeared  to  be  similiar  to  those 
given  by  instructional  developers.    The  real  truth,  he  said,  is 
that  teacher  educators  are  teaching  teachers  to  be  educational 
craftspeople  under  the  als taken  assuaq^tion  that  teachers  can  be 
creative.    Dr.  Z  believes  that  mediated  adaptive  instruction  can 
take  over  many  of  the  functions  of  the  teacher.    Technology  can 
mke  use  of  specialization  in  educational  planning  and  thereby 
could  provide  a  much  richer  classroom  environment  than  that 
currently  provided  by  most  teachers  according  to  Dr.  S. 

Conclusions 

Four  conclusions  were  reached  about  faculty  views  of 
instructional  development.    These  four  conclusions  are  tentative 
and  apply  only  to  some  of  ths  respondents  who  took  part  in  this 
study. 

Conclusion  #1:  Diversity  of  7iews  ahmit  Tnfttructional  Development 

There  is  considerable  variation  in  opinion  about  the  value  of 
systematically  developed  instruction  among  teacher  educators, 
a?  preconceptions,  perhaps  due  to  my  immersion  in  the  culture  of 
instructional  design,  were  that  teacher  educators  would  not 
encourage  the  use  of  instmctional  design  processes  or  products. 
This  preconception  was  true  in  some  cases.    My  final  teacher 
educator  respondent  told  me  that  there  were  some  (a  minority) 
teacher  educators  who  believed  that  systeitatically  developed 
instruction  is  very  shallow  education.    The  process  of 
instru^;tional  development,  according  to  this  view,  limits  education 
to  ^t  is  mechanical. 

•niere  are  teacher  educators,  however,  with  a  very  different  view 
of  systematically  designed  instruction.    All  but  one  of  the  teacher 
educators  in  this  study  were  positive  about  the  products  and 
processes  of  educational  technology. 

Conclusion  »2:  Iteawareness  of  Diverse  Yiaws  about  Technology 

The  teacher  educators  and  instructional  develjpment  faculty  who 
participated  in  this  study  were  aware  that  there  exists.,  within 
their  om  fields,  a  variety  of  views  about  the  virtues  of 
systematically  designed  instruction.    These  respondents  were  not 
aware,    however,  of  the  variety  of  views  on  this  same  topic  within 
the  other  field. 

Both  of  my  final  respondents  (Dr.  £  and  Dr.  Z)  discussed  the 
controversy  in  their  own  fields  concerning  the  strengths  and 
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weaJmesses  of  systematically  designed  instruction.    At  the  *ame 
time,  they  directly  stated  and  iiq)lied  (see  Appendi::  C)  that 
individuals  in  the  other  field  vere  all  of  liKe  mind. 

Uy  final  instructional  development  respondent  (Dr.  Z)  told  me 
that  his  owd  views  ahout  technology  in  schools  differ  with  the 
vievs  Gichael  Streihel  presented  in  a  recent  issue  of  ECTJ  (1986). 
Streihel  argues  that  systematically  developed  computer  drill  and 
practice,  tutorials  and  simulations  are  handful  to  learning.  Dr.  Z 
infered   that  teacher  educators  hold  a  similiar  visv  (see  ^pendix 
C). 

Yet  this  ms  not  the  only  view  ahout  technology  held  by  teacher 
educators.  Host  of  the  teacher  educator  respondents  had  a  very 
pro-technology  attitude  towards  instruction,  even  to  the  point  of 
saying  that  the  teacher  may  be  replaced  in  part  by  the  coi^uter 
(see  ^pendix  B). 

Conclusion  »3:  Different  Assumptions  about  Teacher  Potential 

At  the  root  of  the  differences  in  belief  about  the  place  of 
systematically  designed  instruction  are  some  fundamental  questions 
about   the  abilities  of  teacher  education  students  and  teachers  in 
general.    Ify  final  instructional  development  respondent.  Dr.  Z, 
made  it  very  clear  that  he  thought  teacher  education  students  were 
of  low  quality  and  had  little  of  the  creativity  that  curriculum 
developers  assume  them  to  have.    According  to  his  position,  this 
lack  of  ability  and  creativity  is  the  primary  reason  that 
scientifically  developed  instructional  materials  are  needed  in  the 
classroom.    9hen  I  asked  him  if  such  materials  would  be  necessary 
if  teachers  were  able  3Z;l  creative  he  answered  no. 

Uy  final  teacher  education  respondent.  Dr.  E,  had  a  different 
view  of  teacher  potential.    He  felt  that  there  were  teachers  with 
talent  and  that  such  talent  needs  to  be  used.    In  an  article  he 
showed  me  this  respondent  had  written  "Vhile  there  are  many 
teachers  who  want  (and  a  few       need)  to  be  told  exactly  how  and 
went  to  teach,  if  thoughtful  and  creative  teachers  are  not  allowed 
to  make  meaningful  instructional  and  ciirricular  decisions  then  the 
result  will  almost  certainly  be  a  loss  of  pride  in  one's  work" 
(reference  not  given  to  respect  the  respondent's  anonymity). 

These  two  respondents  agree  that  not  all  teachers  are  capable  of 
developing  their  own  instruction.    Dr.  Z   felt  that  the  problem  is 
acute  enough  to  warrant  restructuring  education  around  materials 
produced  by  experts,  giving  the  teacher  a  si?)porting  role.    Dr.  E's 
view,  however,  was  that  teachers,  given  the  right  education,  will 
be  able  to  function  effectively  and  autonomously  in  the  :^lassroom; 
autonomy  being  the  foundation  of  quality  teaching. 
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Conclusion  »4:   Placing  the  Blame  for  Sducational  Probleas 

I  found  it  interesting  that  my  final  respondents,  whose  views 
about  the  place  of  technology  in  education  were  very  different, 
both  characterized  the  existing  situation  in  the  schools  as 
negative  and  opposite  to  irtat  they  were  proposing. 

Or;  E,  the  methods  teacher,  characterized  the  curreni^  sitimtion 
in  the  schools  as  disenfranchising  and  tightly  controlled  due  to 
the  mandated  use  of  systematically  developed  materials.    Dr.  Z 
characterized  teachers  as  poorly  qualified  but  autonomous 
instructional  decision  makers. 

Discussion 

I  believe  that  the  conclusions  of  this  study  are  related  to  some 
topical  ways  that  individual  human  beings  make  sense  out  of  their 
worlds.    In  this  section  I  explain  how  the  conclusions  of  this 
study  can  be  uztderstood  in  terms  of  some  of  the  ways  that 
iftisunderstandings  and  antagonisms  arise  as  people  interpret  complex 
phenomena. 

Awareness  of  Individual  Ylewpoints 

First,  individuals  sometimes  ignor  the  uniqueness  of  others, 
especially  those  who  are  perceived  as  belonging  to  an  outside 
gro\q>.    Based  on  the  first  two  conclusions  of  this  study,  I  would 
suggest  that  instructional  developers  are  capable  of  forgetting 
that  teacher  educators,  like  all  groiqps  of  people,  are  made  up  of 
individuals  with  diverse  views  on  most  issues.    Here  communication 
with  teacher  educators  would  be  my  advice  to  instructional 
developers  who  wish  to  avoid  the  typical  human  tendency  to  develop 
inaccurate  generalizations. 

Awareness  of  Different  Assuaptions 

A  second  tendency  people  have  when  making  sense  of  their  world 
is  to  forget  that  their  assui^itions  may  be  different  than  those  of 
others.    At  the  root  of  the  debate  over  the  use  of  instructional 
development  are  differing  assumptions  about  the  match  between 
teacher  potential  and  the  goals  of  education.    One  assumption  that 
was  identified  in  this  study  Is  that  education  is  fundamentally  an 
enterprise  idiere  information  and  skills  are  transmitted. 
Furthermore,  teacher  education  students  do  not  have  the  ability  to 
serve  as  the  central  figures  in  such  a  process. 

A  contrasting  assuaption,  also  identified  in  thi^i  study,  is  that 
teacher  education  students  do  have  the  ability  to  serve  as  the 
central  figtires  in  any  educational  setting.    According  to  this 
assuMption,    teachers  must  have  a  central  role  because  education  is 
essentially  a  human  interaction. 
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Ignorix^  that  others  have  different  as^iu^tions  ahout  the  nature 
of  education  and  the  potential  of  teachers  seems  to  hav)  resulted 
in  an  antagonistic  attitude  among  some  instructional  developers  and 
some  teacher  educators.    If  instructional  developers  could  step 
outside  of  their  ovn.  assumptions  ahout  educational  aims  and  teacher 
abilities  they  vould  he  more  lllcely  to  appreciate  and  assist  those 
¥ith  other  assui^tions. 

^l^^TiTW       Blame  • 

A  third  and  final  ireiy  people  tend  to  make  sense  out  of  their 
world  is  to  assume  that  if  something  is  not  vorking  it  must  be 
someone  else' s  fault.    Some  teacher  educators  partially  blame  the 
current  education  crisis  on  systematically  designed  instructional 
packages  T?hile  some  instructional  development  faculty  b.lame  the 
same  crisis  on  teacher  freedom  to  do  whatever  they  want.  A 
constructive  response  towards  these  contrasting  beliefs  might  be 
for  individuals  to  carefully  consider  what  the  other  side  has  to 
say  and  be  willing  to  incorporate  them  into  their  thinking 

Some  Final  "HiouQhts 

As  with  all  naturalistic  studies,  the  complexities  and  unique 
local  features  (as  well  as  the  assumptions  of  the  research 
paradigm)  make  it  impossible  to  generalize  specific  results,  either 
to  the  faculty  members  in  the  school  of  education  where  this  study 
took  place  or  to  any  other  faculty.    However,  the  result  that  I 
hope  this  study  will  have  is  to  provoke  thought  among  those 
Interested  in  working  towards  the  building  of  better  educational 
systems.    ?ith  this  in  mind,  I  would  like  to  share  an  insight  I 
have  gained  from  my  participation  in  this  study. 

I  can  imagine  that  there  are  two  opposing  ways  of  thinking  that 
influence  the  minds  of  both  methods  teachers  and  instructional 
developers:  expansive  thinking  and  disciplinary  thinking. 
Expansive  thinking  is  creative,  unfocused,  innovative,  idealistic, 
irresponsible,  and  humanistic.    Disciplinary  thinking  is 
systematic,  dehumanizing,  objectives-based,  sterile,  and 
utilitarian.    Individual  educators  ten.^  to  be  influenced  more 
strongly  by  one  or  the  other  or  thes^     ys  of  thinking  and  tend  to 
see  less  value  in  the  ideas  of  thost  influenced  by  the  opposing  way 
'  of  thinking.    Sy  hunch  is  that  good  instructional  design  and 
practice  flourish  when  these  two  ways  of  thinking  are  fully 
appreciated  and  balanced. 

Inquiry  aimed  ut  mitklag  sense  of  how  individuals  think  ahout 
instructional  design  and  education  can  play  a  significant  part  in 
communicating  ideas  between  and  among  instruction  developers  and 
others  in  the  educational  community.    Such  inquiry,  if  done  and 
received  in  a  spirit  of  openness  and  fairness,  coulC  have 
widespread  benefits. 
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Appendix  A:  Selected  Data  from  the  First  Stage  of  the  Stvdy 

Interview  With  Dr.  B. 

I  sav  Dr.  B.  in  the  hall  outside  his  office  as  I  arrived  for  our 
first  aeetlBg.    He  offered  me  a  c\q)  of  coffee,  ai]d  got  himself  a 
cvp.    He  told  me  that  his  wife  would  be  bringing  him  his  breakfast 
at  about  8:20. 

I  explained  the  consent  form  to  him  and  he  signed  it  without 
question,  then  I  briefly  explained  the  research  I  was  doing.  I 
told  him  that  I  wanted  to  get  some  idea  of  what  he  thought  teachers 
should  be  taught.    He  told  me  first  that  you  can' t  teach  teachers 
how  to  teach;  in  fact  you  can' t  teach  anybody  anything.    A  person 
has  to  learn  how  to  teach  (or  do  anything).    He  said  that  he  . 
provides  tools  with  ^ch  to  think  about  teaching.    It  is  through 
thinking  that  teaching  can  iaqjrove.    If  teachers  don't  think, 
nothing  will  innprove.    He  said  th£*t  poor  teaching  is  an  easy  job. 

He  teaches  a  five  unit  methods  class  including  lecture,  theory 
and  laboratory.    Students  have  different  kinds  of  laboratory 
experience,  they  can  hide  behind  the  aparatus  at  first  but 
increasingly  move  towards  interactive  teaching. 

He  is  a  cognitive  science  individual.    It  is  most  important  to 
find  out  vb&t  students  know  and  add  to  that.    He  interview 
students,  talks  to  them,  listens  to  them  and  then  provides 
activities  that  will  provide  the  next  challenge.  He  added  that  he 
is  not  sure  that  this  is  successful. 

Every  year  he  changes  th*?  course.    Tryin?  to  get  at  something  he 
missed  before.    Now,  in  his  later  career,  he  finds  most  assignments 
are  average  to  above  average-they  meet  vhe  needs  nf  the  students. 
Students  need  to  feel  that  the  course  meets  their  needs,  that  it  is 
worthwhile.    They  need  enthusiasm. 

He  described  some  details  about  his  course: 

•  Students  identify  a  chapter  and  identify  all  concepts  in  a 
manner  consistent  with  Gagne.  They  then  make  a  chart  showing 
how  the  chapt<;r 

treated  the  topic.    Students  make  a  network  diagram  m 
another  assignment.  Students  also  write  performance 
objectives  and  intended  learning  outcomes. 

•  He  is  concerned  that  students  find  objectives  for  each 
category  of  outcome,  not  just  the  typical  cognitive  outcomes. 
He  is  concerned  that  objectives  are  mechanically  correct  and 
that  the  behavior  is  significant.    Students  can  redo 
assignments  if  they  are  turned  in  on  time  and  many  do  (the 
best  teachers  are  often  those  whc  turned  in 

an  assignment  again  for  a  point).    The  objective  of  the 
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course  is  to  become  a  profesioml  not  learn  content:  they 
need  to  gret  better. 

People  have  to  realize  that  they  do  not  need  to  do  it  right 
the  first  time. 

•  Lesson  plans  should  have  'mind  capturss' ,  and  deal  with  the 
past(^t  students  already  know),  pr8sent(what  is  important) 
and  future. 

•  He  helieves  in  formative  testing:  test  early  and  often  (he 
coapared  this  to  Ifeiyor  Daley's  quote:  vote  early  and  often). 
He  believes  that  students  must  create  a  resource  list.  Loolc 
for  the  full  variety  of  resources.     Variety  is  a  powerful 
variable  in  learning.    It  takes  5  years  to  become  a  good 
teacher  perhaps  because  it  takes  5  years  to  locate  all  the 
materials. 

•  Communication  is  the  most  important  process  skill. 
Science  begins  and  ends  with  a  hypothesis  (not  observation). 

•  His  students  are  encouraged  to  implement  with  existing 
mater iSils,  not  reinvent  the  wheel,  ^ch  is  Tdiat  most 
beginning  teachers  tend  to  do.    To  do  a  good  job  you  have  to 
be  a  good  thief. 


2.  SuBuaary  of  Dr.  B's  Views  on  ^iaat  is  Important 

Introduction:  The  following  information  is  derived  from  a 
series  of  three  interview.    The  first  was  open  ended  and 
resulted  in  a  list  of"  items  that  are  ia^ortant  in  the  teaching  of 
a  secondary  science  methods  course.  The  second  and  third 
interviews  were  uSwi  to  clarify,  confirm  and  extend  this  list  of 
items. 

The  focal  question  of  this  study  became  :  '^at  is  important 
in  teaching  a  secondary  science  methods  course?'    The  list  of 
important  items  is  given  below.    These  items  are  organized  into 
categories  and  subcategories  to  assist  the  reader. 

rrEMS  ARE  LISIED  BELOff  ALONG  TOH  A  REASON  [IN  BRACKETS]  THAT 
EACH  rren  is  IHPORTANT.    Following  most  of  the  items  is  a  number 
(1,2  or  3)  which  indicates  the  relative  importance  of  that  item 
and  a  letter  (A.  B  or  C)  ^Mch  indicates  the  relative  success  the 
course  has  at  achieving  that  item.    (The  respondent  noted  that 
the  relative  success  of  an  item  is  related  to  ^.en  the  item  is 
presented  during  the  semester:  those  items  presented  later  tend 
to  be  more  successful  because  more  prerequisite  learning  has  gone 
on. ) 
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Category  1;  IT  IS  nffOmUT  THAT  TOE  HETOODS  "lEACHESS  REHEHBES 
THESE  IDEAS 

1.  Provide  tools  with  which  to  think  ahout  teaching[you  cannot 
teach  anyone  any^-hing,  they  have  to  do  the  learning 
themselves 1  {3/B} 

2.  Frequent  evaluation[ provides  the  optimal  amount  of 
uncertainty:  positive  tension)  {2/A} 

3.  Students  should  realize  it  is  possible  for  everyone  to  get 
full  credit  for  an  assignment[30  they  can  pass  this  attitude 
to  their  own  students]  {2/B  or  C} 

4.  The  role  of  the  critic  teacher  is  iaqjortant  [this  teacher 
has  a  lot  of  tredihility]  {2} 

5.  Schools  need  to  reform  [teachers  need  more  authority  and 
responsibility]  {3/B} 

6.  Hodel  appropriate  teaching  behavior[ there  is  no  credibility 
in  the  attitufle:  Don't  do  as  I  do,  do  as  I  say]  {2/B} 

7.  Students  should  be  taught  that  which  they  perceive  will  be 
useful  [:f.or  teacher  credibility]  {1/B} 

.Category  2:  IMPORTANT  GUIDING  PRDICIPLES  FOS  TEACHERS 

*  Subcategory  2. 1  OTO.iL  PRINCIPLES 

8.  Find  out  ^t  students  already  know  and  build  on 

that[ cognitive  science  has  pointed  this  out  as  an  effective 
strategy]  {3/B+} 

9.  Project  the  message  that  students  can  and  will  leam[  this 
is  a  self-fullfilling  prophesy]  {3/A-} 

10.  Know  the  characteristics  of  future  pi^ils  [think  of  them 
as  being  not  future  scieroe  teachers  but  in  the  great  variety 

•   of  roles  they  will  play]  {3/B} 

11.  Maximize  student-student,  student-teacher 
interaction[ learning  is  an  active  process]  {3/B-} 

12.  Realize  that  students  do  not  have  to  do  things  right  the 
first  time  [we  need,  to  practice]  {3/B} 

13.  Find  relations  between  concepts  (networking)  [relationships 
are  the  glue  that  hold  ideas  together]  {3/A-} 

Subcategory  2. 2  SCIENCE  PRINCIPLSS  (THESE  SHOULD  BE  THE 
RESPONSIBILnr  OF  ARTS  ANDSCIENCE,  NOT  TEACHER  EDUCATION) 

14.  Realize  science  is  not  9hat  is  in  a  science  textbook,  that 
science  has  wrong  paths,  frustrating  moments  ...  it  is  not  all 
neat  and  clean  [they  have  often  missed  this  despite  l^eing 
science  majors]  {3/B} 

15.  Do  scientific  thinking,  which  is  making  hypotheses  based 
on  information  {3/B} 
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16.  Teach  the  xmlerstanding  of  relationships[it  important  to 
tai0¥  hov  and  iJhy  you  kno^  things]  {?JB} 

Category  3:  PREPARING  TEACHERS  FOR  THE  CLASSROOH  IS  HIPORTANT 
Siibcategory  3.1:    <2NERAL  PREPARTION 

17.  Identify  resourcesC  variety  is  a  powerful  variable  in 
learning]  {3/B} 

18.  Be  aware  of  science  education  issues[for  job  interviews, 
comunication  with  colleagues]  2/B} 

19.  Learn  to  use  the  laterial  in  the  AY  learning 
laboratory[  teacing  aids  can  be  a  great  help  in  saving  time  and 
allowing  more  teacher  contact  with  the  class;  technologies 
need  to  be  used  properly]  {3/B} 

20.  Teach  using  the  strategy  of  'hands  on,  minds  on'Cleamiiag 
is  an  active  process]  {2/B+} 

21.  Understand  different  categories  of  intei.d^  learning 
outcomes[  to  avoid  a  myopic  view  of  learning]  {2/B} 

22.  Identify  concepts[ concepts  are  good  handles,  they  are  more 
.generalizable  than  facts]  {2/A-} 

23.  Ask  productive  questions  (those  which  students  c^Ji 
an3wer)[because  bad  questions  are  common  and  serve  no  purpose] 
{3/B+} 

Subcategory  3.2:  LESSON  PLANS 

24.  Prejpare  lesson  plans[  otherwise  variety  is  not  possible] 
{2/A-} 

25.  Find  objectives  for  many  different  cognitive 
outcomes[ otherwise  only  one  type  tends  to  be  taught:  knowing 
facts  {2/A-} 

26.  Prepare  a  case  history  lesson  plan(dry  lab) [variety] 
{2/A-) 

27.  Prepare  a  laboratory  lesson  plan[this  is  difficult  to 
jj^)lemeni  properly]  {2/A-} 

28.  ?rite  performance  objectives  or  a  table  of  specifications 
with  significant  behaviors[so  the  objectives  are  nirc  formal 
but  useful]  {2/A) 

29.  Design  mind  captures  for  lesson3[to  get  the  students 
attention]  {2/B} 

30.  Put  question  sequences  in  lesson  plans[this  defines  the 
path  of  the  lesson^  it  is  the  operational  definition  of  the 
objectives.  {1/A-} 

31.  Classify  questions  according  to  the  type  of  outcome[to 
insure  a  variety  of  question  types]  {2/A} 
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SuUcategory  3.3:  PRESEirTATION 

32.  Be  able  to  coaaunicateC  writing  and  talking  prove  that  you 
Knov  something  and  give  you  practice  thinking]  {3/B+} 

33.  Get  students  to  pose  questions  at  the  right  time,  not 
before  the  interest  is  there[otherT7ise  leamlrig  is  tiighly 
perishable]  {3/B} 

34.  RjBceive  feedback  on  presentationsCso  they  can  work  on 
weaknesses]  {3/B} 

35.  Uaking  oral  presentation3[for  practice]  {2} 

36.  Videotaping  oral  presentation3[for  feedback]  {2/B+} 
Subcat^ory  3.4:  EYALUATIOH 

37.  Know  how  to  do  formative  evaluation[ provides  corrective 
feedback]  {3/ A} 

38.  Know  how  to  write  a  formative  test[the  philosopbv 
implicit  in  formative  testing  is  ii^jortant:  what  is  it  that 
students  still  need  to  learn?  vs.  ^t  do  students  not  know?] 
{3/B} 

39.  EvalXJate  software[so  they  know  what  is  valuable]  {2/ A-} 

40.  Evaluate  textbooks[30  they  know  ^t  to  expect  from  a 
textbook]  {2/B} 
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Appendix  B:  Selected  Data  from  the  Second  Stage  of  the  Study 

1.  Responses  of  Instructional  Development  Teachers 
Question  1:  ^t  are  the  most  ia^portant  things  teacher 
education  students  should  learn  ahout  using  technology  in 
education? 

Question  2:  my  do  you  believe  this? 
Dr.  2 

1-  Learn  to  retain(and  make  the  best  use.  of)the  integrity  of 
technclugically-based  instruction  instead  of  second-guessing 
decisions  that  have  already  been  used.    Don' t  cannibalise 
.instructional  packages. 

2.  The  vast  Majority  of  teachers  have  a  king-of-the-hill 
attitude  xiben  most  of  them  haven' t  risen  above  the  peasant 
level.    They  need  to  accept  technologically-based  instruction 
on  at  least  an  equal  footing  OT.th  their  owi. 

Dr.  Y 

1.  a)  Tbey  should  understand  technology  as  a  process  i.  e, 
ASSURE  model.      b)'niey  should  knoF  the  cbaract eristics  of 
various  media  and  hov  they  fit  into  the  process, 

2.  Usiiig  a  procedural  model  (such  as  ASSURE)  can  increase  the 
effectiveness  or  th  eteachiiig  learning  process  and  that  is  an 
important  objective  of  education. 

Dr.  X 

1.  ^en  the  findings  and  principles  of  the  behavioral  sciences 
(psychology,  anthropology,  linguistics,  artificial 
intelligence,  etc.  )  are  applied  to  the 

analysis  and  solution  of  the  problems  of  instruction, 
resulting  in  ever  more  effective  teachlx^g,  we  h8.ve 
instructional  technology.    Teachers  need  to  know  how  to 
design,  develop,  deliver,  and  evaluate  instruction.    But  no 
one  person  can  do  all  this.    ¥e  will  have  to  specialize. 

2.  A  purely  intellectual  exercise  growing  out  of  the 
definition  of  technology  (and  instruction)  combined  with  what 
little  I  know  about  the  sciences  that  could  lead  to  an  applied 
educational  art:  instructional  technology. 

Dr.  ? 

1,  a.  Soft  technology:  The  concepts  of  instructional  design  in 
general.    Hie  process  of  instructional  development  at  thv^ 
classroom  level. 

b.  Hard  Technology:  Use  of  chalkboard,  bulletin  board, 
overhead,  iTilm  projector,  VCR,  using  computers 
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2.  Hy  position  clearly  is  that  teaching  be 
objectives- centered/ child-centered  and  not 
technology-centered.  In  technology  use  I  like  teachers  to 
learn  to  use  the  chalkboard  as  tcII  as  the  coiaputer. 

2.  Responses  of  Teacher  Educators 

Question  1:  TJhat  are  the  most  iiq)ortant  things  teacher 

education  students  should  learn  about  using  technology  in 

education? 

Question  2:  ¥hy  do  you  believe  this? 
Dr.  B.  (a  science  methods  teacher) 

1.  Students  should  learn  that  technology  can  often  deliver  and 
collect  information  faster  and  more  efficiently  than  can 
humans. 

2.  Whenever  the  coixpater  is  faster  and  more  efficient  it 
should  be  used  to  assist  in  instruction.  I  do  not  see 
computers  replacing  teachers  in  my  lifetime,  however  they 
could  replace  the  information  providing  role  of  teachers  ver/ 
easily. 

.Dr.  C  (an  art  methods  teacher) 

1.  a.  Be  prepared  to  build  instructional  data  base3(usually 
verbal)--get  ready  for  xrtien  they  become  available  from  some 
centralized  source. 

b.  Word  processing/E-mail/ spreadsheet  tools  are  essential 

c.  Some  preliminary  programming-to  understand  the  process  of 
machine  operation  first  hand  (graphics  are  very  good  for  this) 

d.  Experience  with  various  interactive  devices/programs: 
educational  applications  must  feature  interactivity  and 
individualization 

2a.  Involvement  with  a  course  on  con^uters  for  teachers  sines 
its  inception 

b.  Involvement  with  simulated  databases  for  16  years  and 
retrieval  for  educational  applications 

c.  Reading  literature  of  congjuter  based  education 

d.  Teachi^  computer  graphics  to  teachers 

e.  Continuous  i^e  of  my  own"  coii?)uter 

Dr.  D  (a  reading  methods  teacher) 

1  a.  ^?hat  areas  technology  may  be  useful,  i.e.  management, 
instruction,  etc. 

b.  How  technology  may  enhance  learning  for  students. 
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2.  In  order  to  uwike  the  most  iise  of  technology  it  is 
important  to  Icnov  the  specific  areas  ijhere  it  (technology)  has 
the  greatest  potential.    Secondly,  ve  should  base  all  our 
technology  in  terms  of  ho^  it  ^11  improve  or  enhance  student 
learning.    We  need  to  keep  focused  on  ^t  its  use  does  and 
not  on  what  it  looKs  like. 
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Appendix  C:  Selected  Data  Froa  the  TJard  Stage  of  the  Study 

Interview  ¥ith  Dr.  E  .  His  Office.  9:30  -  10:30 
I  started  by  telling  Dr.  E  about  my  research:  characterizir^ 
it  as  a  study  of  how  methods  teachers  and  ID  teachers  view 
teacher  education.    I  then  gave  Dr.  S  my  three  tentative 
conclusions  and  asked  him  to  comment  on  them. 

Conclusion  1:  There  is  little  difference  between  how  each 
group  promotes  instructional  design  tools  like  objectives  and 
evaluation. 

Dr.  E  said  that  did  not  siqjrise  him:  that  methods  teachers 
have  had  and  do  have  a  technocratic  view  of  teacing.    They  are 
utilitarian  and  emphasize  techniques. 

He  does  not  hold  this  view.    He  believes  that  the  goal  of  . 
teacher  education  should  be  to  make  teachers  more  ref lectivs 
about  the  teaching  process,  (see  Dewey  on  the  delation  of 
Hieory  to  Practice,  circa  1904)   Knowledge  should  be  presented 
as  problematic,  not  absolute.    This  is  not  to  say  that 
objectives  should,  not  be  taught:  but  they  should  be  explored, 
discoverijag  the  trade-offs.    It  is  important  to  deal  with 
•issues  such  as  serial  injustices.    A  safe  environment  must  be 
provided  for  teachers. 

Conclusion  2:  Methods  teachers  are,  if  anything,  more  positive 
about  the  role  of  physical  technologies,  such  as  the  computer, 
improving  the  status  of  education. 

Dr.  E  said  that  this  was  not  sxiprising  because  methods 
teachers  have  little  historical  perspective.    As  Dewey  said, 
they  are  suseptible  to  fads  becaxise  they  do  not  see  themselves 
as  a  body  of  intellectuals.    They  believe  that  technologies 
would  do  more  of  what  we  do   now  only  better.  In  essence 
coB^^uters  are  being  put  to  limited  use:  mainly  to  do  workbook 
type  things.    Teachers  are  being  treated  as  mindless 
individuals.    In  some  i^per  class  schools  there  may  be  an 
attempt  to  see  technology  used  creatively.  In  nther  schools  we 
will  see  only  glorified  workbooks. 

Conclusion  3:  Teacher  educators  are  willing  to  -consider  the 
notion  that  the  information  presenting  rolf  of  the  teacher  can 
be  taken  over  by  mediated  instruction. 

Dr.  E  said  that  teachers  are  seen  primarily  as  managers  who 
are  not  supposed  to  be  thoughtful.    The  conception  of  learning 
varies.    Some  believe  that  children  bring  something  to  the 
learning  situation. 

The  perspective  of  the  society  is  restricted  as  are  the 
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views  of  most  teacher  educators.  Dr.  E  believes  that  teachers 
are  being  disenf  ranchiseu  and  deskilled  by  not  beina  allowed 
develop  their  owa.  instruction. .  Now,  teaching  function  is 
largely  managerial  and  is  being  moved  more  that  way.  The 
programs  being  developed  are  often  based  on  narrow  methods, 
and  assume  that  there  is  someone  who  can  do  it  better.  In 
this  view  it  is  asumed  that  we  need  to  be  more  specialized  and 
that  kids  are  similiar  to  each  other.    Hiis  is  elitist  and 
belies  common  sense.    It, makes  people  ^o  design  programs  feel 
good  about  themselves.    But  they  see  education  as  if  it  were 
like  putting  lots  of  bumper  stickers  on  a  car. 

December  18  Interview  With  Dr.  Z.  His  Office  10:30-11:15 

I  introduced  my  study  and  then  asked  Dr.  Z  to  comment  on  the 
three  conclusions  I  had  reached. 

1.  Both  teacher  educators  and  1ST  professors  promote 
instructional  development  tools  such  as  objectives  and 
formative  evaluation. 

Dr.  Z  made  the  point  that  the  tools  such  as  evaluation  and 
objectives  can  mean  very  different  things  to  different  groups. 
Evaluation  is  usually  not  used  as  a  way  of  improving  products 
by  teachers,  although  the  best  of  them  will  vise  it  as  a  means 
of  ia^roving  their  own  performance. 

Objectives  too  can  mean  diferent  things.    Is  the  final  exam 
based  on  the  objectives?  In  short,  we  must  always  be  skeptical 
of  postures. 

Conclusion  2:  Teacher  educators  are  positive  about  using 
physical  technologies,  in  fact,  perhaps  more  positive  than  ID 
professors. 

One  way  that  an  undergradtiate  media  course  was  eliminated 
was  by  having  this  incorported  into  methods  courses.  Hiis 
would  tend  to  make  media  trjaching  more  ancillary.  Teacher 
educators  are  in  the  business  of  teaching  teachers  to  be  king 
of  the  hill  and  we  are  part  of  the  hill.    You  also  have  to  be 
careful  about  what  people  say;  if  you  ask  people  in  media 
centers  if  they  use  instructiona  development  they  will  say 
yes. 

Dr.  Z  said  that  if  questions  are  posed  at  a  sufficiently 
high  level  of  abstraction  you  can  get  agreement. 

Conclusion  3 :  Teacher  educators  are  willing  to  consider  the 
notion  that  the  information  presenting  role  of  the  teacher  can 
be  taken  over  by  mediated  instruction. 
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Teachers  educators  kid  themselves  ahout  the  value  of  the 
products  they  turn  out.  TTiey  are  scraping  the  bottom  of  the 
barrel.    There  are  indications  that  teachers  like  good 
materials  that  have  been  prepared  for  themselves  but  that 
curriculum  developers  keep  pushing  the  notion  that  teachers 
need  to  be  creative.    They  keep  spinning  out  the  notion  that 
teachers  have  expertise  and  provide  them  with  more  strategies 
than  they  could  ever  use.  Teachers  are  really  looking  for  all 
the  help  they  can  get.    The  restl  reason  for  teacher  burnout  is 
the  strain  and  stress  caused  by  having  to  do  so  much. 

It  is  so  difficult  to  make  use  of  what  we  are  learning  about 
designing  materials:  Gagne's  and  Merrill's  ideas  are  not" 
applicable  by  teachers  who  do  not  have  the  time  or  ability  to 
learn  them. 

It  is  possible  to  teach  problem  solving  and  other  kinds  o' 
thinking  using  mediated  instruction  in  the  form  of  adaptive 
instruction.    Jerome  Bruner  said  that  when  he  wrote  his  book 
that  he  wanted  to  provide  material  that  teachers  were  not  iqp 
on  and  to  model  the  discovery  and  problem  solving  type 
learning  that  teachers  were  not  using. 

Dr.  Z  said  that  he  could  not  imagine  a  more  stimulus  poor 
environment  than  being  in  a  classroom  with  a  single,  poor 
teacher.    Technology  can  make  use  of  specialization  of 
knowledge,  is  more  reliable,  can  spread  the  expertise  of  the 
few  expert  teachers  that  we  have. 
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Interest  in  learning  strategies  stems  from  a  real  concern 
for  the  academic  performance  of  students*    Whether  the  ccuse  is 
poor  teaching  methods,  inadequate  curricula,  or  their  ovn 
indifference,  students  are  failing  to  succeed  in  the  classroom, 
and  the  problem  is  widespread  and  severe*    The  H^tlon  At  Risk 
IliAfil  and  the  Hatlonal  AgBecgment  of  EducAtiQnal  Progress 
presented  discouraging  news  to  educators*    The  reported  results 
revealed  that  some  23  million  American  adults  are  functionally 
illiterate,  28  percent  of  high  school  students  cannot  read  with 
literal  comprehension  and  51  percent  cannot  write  letters*  In 
addition,  the  studies  showed  a  steady  decline  in  the  overall  ' 
performance  in  high  order  th.^-^king  skills  over  the  last  two 
decades.    Students  were,  on  tue  whole,  unable  to  read,  write  or 
comprehend  at  standards  established  more  than  twenty-five  years 
ago  (The  National  Commission  on  Excellence  in  Education,  1964; 
Task  Force  on  Education  of  Economic  Growth,  1983). 

Based  on  the  findings,  Paul  Copperman  concluded  that: 

"for  the  first  time  in  the  history  of  our  country,  the 
educational  skills  of  one  generation  will  not  surpass,  will 
not  equal,  will  not  even  approach,  those  of  their  parents'* 
(p. 11). 

Other  contributors  to  the  Nation  At  Risk  study  concluded 
that  "the  educational  foundations  of  our  society  are  being  eroded 
by  a  rising  tide  of  mediocrity  that  threatens  our  very  future  as 
a  nation  and  a  people"  (p.5). 

The  Demand  for  Reform 

To  stem  the  "tide  of  mediocrity'*  and  stop  "the  erosion  of 
the  educational  foundations,"  the  HAR  Commission  recommended  such 
reforms  as  more  rigor  in  the  curriculum,  higher  standards  of 
performance  and  expectations,  lengthening  the  school  da,'  and 
year,  and  making  more  effective  use  of  time  during  the  school 
day. 
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The  NAR  ConiDicsion  further  claimed  that  these  reforms  could 
be  largely  accomplished  through  the  children's  own  efforts.  This 
suggests  that  it  is  up  to  the  student  to  perform  to  his  or  her 
utmost  ability  in  order  tc  f^\\cceed  in  the  new,  more  rigorus, 
classroom.    Yet  at  the  same  time,  this  increased  efiort  is  being 
asked  of  the  very  same  children  who  are  at  an  all  time  low  in 
school  achievement • 

Leaving  it  up  to^  students  to  adapt  to  the  more  rigorus 
classrooja  is  more  likely  to  lead  to  failure  than  success.  B.F. 
Jones  (1986)  argues  that  the  demand  for  rigor  without  an 
accompanying  emphasis  on  improving  the  quality  of  instruction 
will  increase  the  number  of  failures  at  all  levels  of  schooling" 
(p. 6).    Resn^ck  (1984)  also  voices  concern  that  the  calls  for 
reform  may  lead  to  a  widening  of  the  gap  between  high  and  low 
achieversi    Efforts  must  be  made  to  develop  quality  instructional 
progriims  for  both  high-  and  low  achieving  students.  Without 
proper  guidance,  it  is  doubtful  that  students  will  succeed  in 
this  endeavor  (Jones,  1986). 

The  success  or  failure  of  students  in  the  learning  process 
may  also  depend  on  their  own  skills  in  activating  learning 
strategies  relevant  to  the  instructional  task.    It  has  been  found 
that  effective  learners  spontaneously  generate  an^  use  specific 
strategies  when  interacting  with  the  instructional  materials 
(Anderson,  1980a;  Berber,  1978).     In  contrast,  novices  and  low 
achieving  students  do  not  generate  strategies  spontaneously 
(Rohwer,  1980).    The  ability  to  assimilate  these  strategies  and 
apply  them  to  a  variety  of  instructional  tasks  may  improve 
students'  performance  in  the  classroom. 

While  educators  often  assume  that  students  know  how  to 
approach  and  optimally  manage  their  own  learning,  this  may  not  be 
the  case.      In  reality  children  need  to  be  taught  to  learn  and  to 
use  new  information  and  skills  efficiently.    One  possible  way  of 
meeting  this  need  is  to  provide  explicit  instruction  in  the  use 
of  learning  strategies  that  iielp  children  in  their  acquisition  of 
new  concepts. 

Background  of  the  Study 

Learning  Strategies 

Learning  strategies  are  those  self-generated  methods  that 
students  use  to  process  information  for  later  retrieval.  Common 
etrategies  include  mnemonics,  rehearsing,  paraphrasing,  imagery 
(Weinstein,  1979;  Pressley,  1984;  Brown,  1980;  Rigney  &  Munro, 
1981).    Recent  research,  however,  suggests  that  not  all  students 
generate  or  use  appropriate  strategies,  but  instead  tend  to  rely 
upon  those  which  are  familiar  or  easy  to  use  (Weinstein,  1978, 
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1981;  Brown  &  Smiley,  1978;  Rigney,  1978;  Fohwer,  1980;  Battig, 
1979). 

Battig  (1979)  states  that  there  is  wide  variation  in 
students'  abilities  to  generate  and  use  strategies.  Shuell 
(1980)  suggests  that  an  individual's  learning  strategies,  once 
aqcuired,  are  relatively  constant  and  stable.    Once  a  particular 
strategy  is  learned,  it  then  can  become  a  stable  factor  within 
the  learner  for  his  or  her  own  use. 

Training  of  T.^arning  Rf.rategies 

The  purpose  of  providing  instruction  on  learning  strategies 
is  to  make  specific  strategies  and  methods  available  to 
individuals  (Weinstein  &  Mayer,  1986).     Furthermore,  Rigney 
(1980)  maintains  that  the  purpose  of  training  is  to  insure  that 
such  strategies  facilitate  rather  than  interfere  with  learing, 
and  that  they  displace  the  less  efficient  strategies  already  in 
use. 

In  oi*der  to  aseist  learners  in  achieving  those  purposes, 
researchers  have  begun  to  investigate  ways  to  train  learners  to 
use  strategies.^    To  date,  research  has  explored  the  expiicitness 
of  training  procedures.    However,  while  there  are  some  common 
training  procedures,  they  may  vary  according  to  the  design  of  the 
training  program  and  whether  strategies  are  taught  singly  or  in 
combination. 

Expiicitness  is  the  type  and  quantity  of  directions  on 
strategy  use  provided  within  the  training.     For  example, 
Weinstein  and  associates  (Weinstein ,  Cubberly,  Wicker,  Underwood, 
Roney,  &  Dxxty,  1981)  reported  several  studies  which  investigated 
the  effect  of  two  versions  of  training  over  no  strategy  training. 
Two  types  of  instruction  occurred,  informed  and  explicit. 
Informed  training  described  the  learning  strategy  and  advocated 
its  use  while  the  explicit  training  included  direct  instruction 
on  strategy  use,  examples  with  practice,  and  corrective  feedback. 
The  results  significantly  showed  that  explicit  instruction  was 
imore  effective' than  the  informed  version  and  that  both  were  more 
effective  in  improving  posttest  performance  than  no  training  at 
all. 

Brown,  Campione  and  Day  (1981)  also  investigated  three 
variations  of  expiicitness:     1)  in  blind  train-ing^  isitudents  were 
told  to  use  a  strategy;  2)  in  informed  training,  students  were 
told  to  u^e  a  strategy  and  how  it  would  help  their  learning;  and 
3)  in  6el:'\'CQntrolled  -training^  ^t.nH#>nt.ft lu^r^  shown  how  to  use 
the  sr^rategy    s  well  as  how  to  monitor  and  evaluate  their 
strategy  use..    They  were  also  told  how  the  strategy  would  help 
their  learning.    The  report  suggests  that  the  more  explicit  the 
training  was  the  more  powerful  its  effect  on  performar.ce. 
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Dansereau  (1985)  also  considers  nodelihg:  (the  demonstration 
of  strategy  use)  in  conjunction  with  feedback  on  learner  output 
as  important  components  of  training.    Further i  Babbs'.and  Hoe 
(1983)  reported  that  explicit  instruction!  which  included 
specific  directions,  demonstrations  of  strategy  use,  and  planned 
practice  is  beneficial  to  the  young.    Burger »  Blackburn,  Holmes, 
and  Zetlin  (1978)  found  similar  results  in  a  study  using  young 
children.    Those  subjects  who  were  trained  to  actively  sort  and 
cluster  pictures  had  significantly  improved  recall  over  those  who 
did  not.    Other  researchers  have  found  similar  results  (Pressley, 
1984;  Butterfield  &  Belmont,  1977;  Canelos  &  Taylor,  1981). 

The  research  on  learning  strategy  training  suggests  several 
components  as  necessary  for  effective  teaching  of  strategies. 
These  are  as  follows: 

1.  Demonstrating  correct  strategy  usage. 

2.  Providing  an  explanation  of  its  utility  in  learning  a 

task. 

3.  Planning  for  active  particxp&oion  and  practice  by  the 
student. 

4.  Providing  for  feedback  on  performance. 

Overall ,  f  indihgf>  f  rr  m  these  studies  suggest  that  explicit 
training  in  strategy  usage  is  more  powerful  than  simply  telling 
students  to  use  a  strategy.    However,  both  types  of  instruction 
tended  to  produce  better  performance  than  no  strategy  inctruction 
^t  all. 

While  it  appears  that  students  can  be  trained  to  use 
strategies,  the  generalization  or  transfer  effects  have  yet  to  be 
found  in  the  literature  (Canelos ?  1979;  Brown,  1981;  Weinstein, 
et  al.i  1978,  1979;  Dansereaa,  1978).    Lawson  (1980)  states  that 
while  "^-^he  promise  of  benefits  from  training  appear  obvious,  those 
rea?     <dd  thus  far  have  been  disappointing.    This  may  be  due  to 
other  influencing  factors  within  the  instructional  environment . 

Learning  Strategies  and  Individuj.1  Differences 

The  application  of  stratgies  may  be  affected  by  individual 
differences  among  learners.    To  date,  most  studies  that  assess 
strategy  training  have  not  looked  at  the  interaction  with 
individual  differences  (Dansereau,  1985,  p.  215).    While  there  is 
potential  for  many  types  of  individual  dif fei^ences,  such  as  leve] 
of  motivation,  task  persistence,  or  locus  of  control,  to  affect 
learning  strategy  usage,  it  may  be  reasonable  to  begin  with  the 
two  learner  characteristics  which  are  most  extensively 
researched.    Age  and  general  ability  may  be  the  learner 
ciiaracteristics  that  interact  with  the  teaching  of  the  learning 
strategies . 
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In  general I  younger  students  use  strategies  less  effectively 
than  older  students  (Brown  &  Szailey,  1978;  Kaili  1979)*  Research 
has  shown  that  children,  can  be  trained  as  e^rly  as  fourth  grade 
to  use  strategies  in  ah  instructional  task;  however <  they  do  not 
use  strategies  to  the  fullest  extent  (Babbs  &  Hoei  i*983;  Burger 
et  al,  1978;  Reinkingi  1983).    This  may  be  due  ^o  the  level  of 
cognitive  development;  prior  to  age  eleven,  children  are  not 
mentally  ready  to  engage  in  effective  strategy  use«    The  mental 
development  of  an  individual  increases  with  age  and  levels  off  at 
adulthood  (Kail,  1979). 

Research  investigating  general  ability  as  a  factor  showed 
that  mentally  handicapped  subjects  could  be  trained  successfully 
to  use' a  strategy.    Despite  an  increase  in  learning  performance, 
however,  transfer  from  one  task  to  another  did  net  occur  (Brown, 
Campione  &  Day,  1881).    Students  in  a  norioal  ability  range 
outperformed  mentally  handicapped  children  of  the  srme  age 
(Burger,  et  al.,  1978).    Rohwer  (1981)  has  shown  that  higher 
ability  students  have  a  greater  capacity  for  generating 
strategies  than  those  of  lesser  ability.    More  research  is  needed 
on  the  effects  of  providing,  training  in  learning  strategies  to 
students  jf  differing  intelligence  levelr. 

Lfearrning  Strategy es  and  the  Instructional  OutGomee 

The  type  of  instructional  putcome  may  alto  affect  the 
training  in  and  transfer  of  learning  strategieJ.    Much  of  the 
research  on  learning  strategies  hds  focused  on  verbal  information 
outcomes;  that  is,  instruction  that  is  concerned  with\memorizing 
a  number  sequence  or  a  vocabulai'ir  word  lirt,  or  sorting  pictures 
(Can^lo,^  &  Taylor,  1981;  Weinstien,  1978;  Burger,  et  al,  1978; 
Pressley,  1983).    According  to  Gagne's  hierarchy  of  instructional 
tasks,  verbal  information  is  at  the  lowest  level  of  learning 
outcomes . 

At  the  highest  level  is  problem  solving,  or  in  Gagne's  terms 
higher  order  rules.    Problem  solving  requires  learners  to  coinbine 
rules  in  some  unique  manner  to  arrj.ve  at  the  unique  solution 
(Dick  &  Carey,  i985).    Research  investigating  problem  solving 
strategies  may  be  associated  with  such  techniques  as 
brainstorming,  Socratic  meti.  d,  mcans-*end  analysij,  and 
incubation  (Anderson,  x980b;  Rummeihart  &  Norman,  1981). 

However,  a  more  central  component  of  school  learning  is 
concept  acquisition.  •  Gagne  states  that  the  loajority  of 
information  learned  in  school  is  comprised  of  concepts.  Of 
particular  interest  to  this  investigation,  are  strategies  that 
can  be  linked  to  concept  acquisition  tasks.    Very  little  has  been 
reported  about  learning  strategies  i^i  conjunction  with  concept 
attainment. 


175 


Early  studies  by  Bosco  and  associates  investigated  use  of 
Bental  imagery  in  concept  attainment  with  significant  results 
(Rosco,  Tennyson,  &  Boutwell,  1973;  1975).    Carrier,  Joseph,  Krey 
and  LaCroix  (1983)  found  that  sixth  grade  students  who  were 
instructed  to  generate  their  own  images  performed  significantly 
better  on  a  concept  attainment  task  than  did  those  who  were 
supplied  with  visuals «    There  was  no  verification  other  than  test 
performance  to  indicate  whether  students  used  the  strategy. 

^       Using  twelfth  grade  subjects,  Park  (1984)  found  that 
instructing  students  to  compare  examples  was  more  effective  on 
posttest  performance  than  having  them  concentrate  on  attribute 
identification*.    However,  the  study  did  not  investigate  whether 
or  not  students  would  generate  images  on  their  own  without 
directions  to  do  so* 

Finally  Allen  (1982}  using  a  concept  task,  also  asked 
subjects  to  create:  their  own  examples  which  were  to  be  similar  to 
and  distinct  from  the  concept  prototype.    While  the  results  of 
hie  dissertation  study  did  not  reach  statistically  significant 
levels,  there  was  a  trend  toward  imj  .*oved  performance  for  those 
subjects  who  generated  their  own  examples  over  those  who  were 
assigned  examples. 

Ih  studies  involving  concept  acquisition  tasks,  there  is 
some  indication  that  having  students  manipulate  examples  leads  to 
improved  test  performance.  However,  these  studies  were  conducted 
with  little  or  no  explicit  training  in  strategy  use. 

Purpose  of  the  Study 

The  primary  purpose  of  this  study  was  to  investigate  the 
potential  individual  and  combinatorial  effects  of  learning 
strategy  training i  and  ability  on  children's  acquisition  of  new 
concepts.    A  second  purpose  was  to  determine  if  use  of  the 
strategy,  generation  of  examples,  would  transfer  to  new  concept 
lessons  once  the  training  had  been  completed.     In  an  effort  to 
relate  the  literature  review  to  the  study,  the  hypotheses, 
research  questions,  and  related  implications  are  presented  below. 

i-^vpoth es is  One 

There  :?culd  be  a  main  effect  for  training.    Subjects  with 
explicit  training  would  have  significantly  higher  posttest  scores 
for  lessons  than  those  in  either  the  informed  or  no  training 
treatments . 

pesearch  Question.  Which  type  of  learning  strategy  training 
is  most  effect.ive  for  use  with  concept  acquisition? 
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Reported  reeults  indicate  that  not  all  students,  .use  learning 
strategies  appropriately,  and  that  they  need  to  be  taught  to 
learn  and  use  learning  strategies  effectively.    Klausmeier  (1985) 
and  Tennyson  and  Cocchiarella  (1986)  advocate  the  development  of 
a  strategy  for  assisting  learners  in  their  concept  acquisition  be 
included  in  the  instructional  design.    However,  there  a 
paucity  of  empirical  research  on  such  training  and  use  as  it 
relates  specifically  to  concept  acquisition. 

It  has  been  found  that  strategy  training  which  provides 
explicit  directions,  a  demonstration  of  strategy  uer,  and 
provisions  for  practice  with  feedback  should  result  in  improved 
test  performance  of  various  instructional  tasks.     It  is 
reasonable  to  assume  that  such  training  would  lead  to  improved 
performance  oa  concept  attainment  tasks. 

Hypothesis  Two 

There  would  be  a  main  effect  for  ability.     Subjects  of 
higher  ability  would  have  significantly  higher  posttest  scores 
than  those  of  lesser  ability. 

Research  Question.     How  does  ability  affect  performance  and 
the  use  of  learning  strategies? 

In  general,  it  has  beon  found  that  students  of  higher 
ability  are  more  capable  of  engaging  effectively  in  instructional 
tasks  and  attain  higher  performance  scores  than  lesser  ability 
students.     It  has  also  been  reported  that  the  higher  ability 
learners  are  able  to  generate  and  use  strategies  effectively  when 
interacting  with  instructional  materials  while  lower  ability 
-Students  do  not.    because  ability  is  a  relatively  stable  trait 
among  learners,  it  is  likely  that  simila*   results  would  occur  in 
this  investigation. 

Hypothesis  Thre*> 

Th^ re  would  be  an  ordinal  interaction  between  treatment  and 
ability.,    the  lesser  ability  subjects  receiving  the  training 
would  outperform  those  of  the  same  ability  level  whc  received 
either  the  infcmed  or  no  training  treatment.    However,  higher 
ability  subjects  in  the  three  treatment  groups  would  do 
comparably  wsll  on  posttests. 

Pesearc^^ Question .     How  does  ability  interact  with  differing 
levels  of  instruction  in  learning  strategy  use? 

Dansereau  (1985)  states  that  most  studies  examining  methods 
of  strategy  traj  .ing  have  not  investigated  the  interaction  of 
training  and  individual  differences.    To  extend  the  research, 
this  investigation  studied  the  in-ceractive  effects  of  differing 
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levels  of  ability  within  the  norzoal  range  of  intelligence  and 
strategy  training  and  use. 

Drawing  upon  the  research  related  to  ability  by  treatment 
interactions  (ATI),  it  has  been  found  that  low  ability  students 
are  assisted  by  explicit  instruction  more  than  higher  ability 
ones.    In  addition  ATI  research  suggests  that  simple 
instructional  support  often  is  useless  or  even  detrimental  tc 
high  ability  students  (Sr.ow  &  Peterson,  1981;  Cronbach  &  Snow, 
1981).    This  study  was  designed  to  investigate  whether  the 
selected  strategy  training  methods  would  assist  lesser  ability 
students  without  hindering  higher  ability  students. 

Hvpoth^Ris  Four 

Those  subjects  who  received  explicit  training  will  ' 
outperform  subjects  in  the  other  treatments  in  the  concept 
lessons  in  the  transfer  sessions. 

Research  Question.     Will  learning  strategy  use  transfer  to 
new  situations  after  training? 

Findings  suggest  that  transfer  is  promoted  by  trying  to 
provide  some  common  elements  of  the  initial  situation  within  the 
new  situations,    transfer  is  also  enhanced  by  identifying  the 
utility  of  strategy  use  to  the  new  situation  (Clark  &  Voogel, 
1985;  Cronbach,  1977).    Derry  and  Murphy  (1986)  advocate  using  an 
unobtrusive  prompt  within  the  instruction  to  assist  transfer  to 
new  situations. 

Methodology 

Sample. 

Subjects  were  drawn  from  an  initial  pool  of  178  sixth  grade 
students  in  two  middle  schools  in  the  upper  midwest.  There  were 
102  iDoys  and  76  girls.  They  were  approximately  twelve  years  old 
at  the  time  the  study  was  conducted. 

Treatments 

Thf;  differences  in  the  three  treatment  conditions  were  based 
on  the  anount  of  training  subjects  received  for  the  learning 
strategy,  self-generation  of  examples.    The  explicit  training 
lEllsubjects  were  taught  to  generate  their  own  examples.  The 
training  consisted  of  experimenter  modeling!  student  practice, 
and  corrective  feedback  on  the  students'  own  verbal  and  visual 
examples  of  the  concept  that  were  drawn  on  scratch  paper. 

The  informed  directions  (ID)  treatment  were  merely  directed 
studenlis  to  make  up  their  examplefe  of  the  concepts  taught.  They 
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were  told  that  they  could  use  the  scratch  paper  to  write  or  draw 
their  exanp^. s*  However,  no  modeling,  practice,  or  feedback  was 
provided . 

The  no  t.r»-ining  fNT)  treatment  group  did  not  receive 
training  in  or  information  on  strategy  use.    For  consistency, 
they  also  received  the  scratch  paper,  but  told  to  use  it  if  they 
needed  to  do  so.    They  read  the  content  narratives  and  completed 
the  activity. 

Treatment  materials 

Five  concept  lessons  were  developed  as  the  instructional 
materials,    the  five  topical  areas  taught  were  prepositional 
phrases,  clouds,  propaganda  techniques,  context  clues,  and 
mollusk  shells.    With  the  exception  of  the  lesson  on 
prepositional  phrases,  all  were  coordinate  concept  lessons.  A 
coordinate  concept  lesson  is  one  that  contains  a  superordinate 
concept  and  two  or  more  subordinate  concepts.    While  these 
rubcategories  share  common  critical  attributes  cf  the  main 
classification,  they  also  have  distinct  characteristics  of  their 
own.    They  were  designed  according  to  the  procedures  prescribed 
by  Teniiyson  and  Cocchiarella  (1986)  and  Merrill  and  Tennyson 
(1977 )•     They  were  self -paced,  self -instructional  materials  in  a 
written  format. 

Content  narratives  were  provided  for  th^:.  NT  treatment  group 
during  the  first  three  sessions.     These  brief  passages  were  the 
placebo  lessons  on  the  topics  of  prepositional  phrases,  clouds, 
and  ipropaganda  techniques.    The  reading  of  the  content  narrative 
and  completion  of  a  short  exercise  were  used  as  means  of 
controlling  for  the  time. 

Instruments 

Several  instruments  were  used  to  measure  the  various 
independent  and  dependent  variables.    Ability  was  measured  by  the 
Cognitive  Skills  Index  of  the  national  standardized  test,  the 
Tests  of  Cognitive  Skills  (CTB-McGraw,  1982). 

Concept  achievement  was  assessed  by  a  total  of  nine 
posttests.    There  were  three  lesson  posttests,  two  immediate 
ppsttests.,  two  delayed  pojt:tests ,  and  two  retention  tests .  They 
employed  a  multiple  choice,  paper  and  pencil  format. 

Scratch  paper  was  provided  as  a  means  to  determine  whether  a 
learning  s*^rategy  was  used  in  the  experiment.    An  opinion  survey 
was  a  supplemental  measure  used  to  obtain  student  perceptions  of 
the  lessons,  their  effort,  and  their  strategy  use* 
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A  pilot  tc*^t  of  the  materials  and  Procedures  was  conducted. 
Based  on  the  results,  one  lesson  was  deemed  unsuitable  content 
for  the  age  level  and  thus  replaced.    The  remaining  lessons  were 
corrected  for  typograjphical  and  spelling  errors.    The  time 
allotted  f r ^  the  lesson  was  increased  to  about  an  hour.  While 
ambivalent'  at  best,  the  results  warranted  further  investigatior 
of  learning  strategy  use  but  with  a  larger  sample  size. 

Subjects  within  each  classroom  were  randomly  assigned  to  the 
three  treatment  conditions.     One  week  before  the  experiment  was 
to  begin,  the  experimenter  visited  each  classroom  to  make 
introductions,  explain  the  procedures,  and  address  any  questions 
that  students  had  regarding  the  study.    At  that  time,  subjects 
were  told  that  their  participation  would  not  affect  their  school 
grades  and  that  all  information  would  be  kept  confidential  and 
^anonymous.    A  list  of  students  assigned  to  the  three  treatments 
was  given  to  each  classroom  teacher  so  that  students  would  be 
resdy  for  the  first  session  the  following  week. 

The  study  consisted  of  two  parts:    training  sessions  and 
transfer  sessions.    The  sessions  occurred  over  a  period  of  six 
weeks  towards  the  end  of  the  school  year.    A  chart  demonstrating 
the  sequence  of  the  instructional  presentation  is  i5hown  in  Figure 
1.01.     There  were  three  one-hour  lessons  in  the  first  part,  of  the 
study,  the  training  Reseione.     At  that  time,  the  ET  and  the  ID 
treatment  groups  were  explicitly  trained  or  informed  on  the 
strategy  (described  previously)..     The  lessons  were  immediately 
followed  by  a  lesson  posttest.    At  the  same  time,  the  NT 
treatment  group  remained  with  the  classroom  teacher  and  received 
the  content  narratives;  they  did  not  receive  a  lesson  posttest. 
Prior  to  conducting  each  session,  experimenters  and  classroom 
teachers  received  written  directions. 


Figure  1.01  about  here. 


The  transfer  sessions  were  the  last  half  of  the  study.  They 
were  designed  to  test  and  compare  the  effects  of  transfer  of  the 
learning  strategy  training  for  the  two  experimental  treatments 
tagainst  the  NT  treatment  group.     Subjects  from  all  three 
treatments  were  grouped  together  in  the  classroom  for  two 
sessions  of  approximately  one  hour  in  length.    They  received  the 
same  directions,  instructional  materials,  and  tests.      A  final 
session  of  approximately  one-half  hour  was  conducted  to 
admin.ister  the  delayed  posttest^,,  retention  tests,  and  the 
opinion  survey.    A  third  experiinenter  delivered  the  directions 
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during  these  eessions  to  control  for  any  potential  experimenter 
bias . 


Design 


The  study  employed  a  one-  f?ay  factorial  design  with  three 
treatment  conditions.    The  dependent  variables  were  analyzed 
ueing  a  multivariate  analysis  of  covariance.    A  repeated  measures 
design  was  employed  on  the  three  training  session  tests  and  the 
six  transfer  sescion  tests.    The  covariate,  ability,  was  assessed 
by  the  composito  scores  on  a  test  of  mental  ability. 

Data  Analyses 

A  multivariate  analysis  of  covariance  (MANCOVA)  was 
conducted  on  the  scores  from  the  immediate  pbsttests  administered 
to  the  two  experimentr^l  groups  during  the  training  sessions. 
MANCOVAs  also  were  conducted  on  the  performance  scores  for  the 
immediate  and  delayed  postests  and  the  retention  tests  of  the 
lessons  in  the  transfer  sessions.     Univariate  ANCOVAs  were  run 
for  those  main  effects  or  interactions  which  reached 
significance.    A  cross  tabulation  was  completed  on  the  secondary 
dependent  measures,  the  scratch  paper,  and  the  opinion  survey 
items  as  a  means  for  comparison  with  test  performance  and 
evidence  of  strategy  use. 

Da.a  analyses  were  conducted  to  yield  reliability  estimates 
on  the  posttests,  descriptive  statistics  on  the  ability  of  the 
subjects  and  performance  measures,  and  tests  of  the  fprmal 
hypotheses . 


Reliability 

Satisfactory  but  moderate  relability  estimates  were  found 
on  each  of  the  immediate,  delayed  and  retention  post^tests.  Item 
analyses  on  an  immediate  posttest  indict        that  some  items  did 
hot  discriminate  well;  the  rest  were  cojiSidered  good 
discriminators.    Because  of  the  poor  it^jjs,  the  relability  of  the 
tcjts  was  probably  lessened. 

DftR^jiript^ve  Statifiticfi 

The  mean  of  the  lesson  posttest  scores  and  the  standard 
deviations  were  similar  for  all  groups.    Table  1.01  shows  the 
scores  for  the  ET  and  ID  treatment  groups  for  the  three  lessons 
during  the  training  sessions.    Mastery  of  the  concepts  was  at 
about  fifty  percent. 


Results 
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Table  1.01  about  here. 


Table  1.02  shows  the  scores  for  all  three  treatments  for  the 
Context  Clues  lesson  given  during  the  transfer  session.  Again 
the  mean  postest  scores  and  the  standard  deviations  were  not 
significantly  different  from  each  other.    It  is  interesting  to 
note  that  the  HT  group  neans  was  higher  than  the  other  two 
groups . 
• 

Similar  results  can  be  seen  in  the  scores  for  the  Mollusk 
Shells  lesson  in  Table  1.03.    Again  there  were  no  statistically 
significant  differences  among  treatments. 


Tables  1.02  &  1.03  about  here. 


Pearson  Product>Moment  Correlation 

Correlations  showed  that  ability  correlated  with  the  tests. 
Also  Table  1.04  shows  that  the  nine  posttests  correlated  with 
each  other  in  general. 


Table  1.04  about  here. 


Formal  Test  of  Hypotheses 

Two  statistical  assumptions  were  tested  before  each  of  the 
MANCOVAs  was  conducted.    First,  the  Bartlett-Box  M  test  for 
homogeneity  of  variance/covariance  matrices  and,  second,  a  test 
of  homogeneity  on  the  regression  slope  for  CSI  ability  across 
cells  were  conducted.  These  revealed  no  significant  difference 
.  and  also  mef^nt  that  there  was  no  aptitude  by  treatment 
interaction  as  hypothesized. 

A  third  p-.iliminary    est  for  order  effect  on  the  performance 
measures  of  the  transfer  sessions  was  conducted.    Because  each  of 
the  sets  of  performance  measures  was  given  to  half  the  subjects 
in  a  different  sequence,  a  test  for  order  effect  had  to  be 
conducted  before  the  data  could  be  pooled.     It  was  not 
significant,  Wilk's  lambda  .98  and  E  (4,  151)  =  .85,  e  =  .50. 
T:;us  the  various  performanc*^  measures  could  be  combined  for  the 
statistical  analyses. 

The  following  were  the  findings  of  this  investigation. 
While  there  the  ET  posttest  bcbres  were  slightly  higher  than  the 
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ID  scores  in  the  training  sessions,  there  was  no  statistically 
significant  difference  among  treatment  condition  posttest  scores. 

The  ET  treatment  used  tho  learning  strategy  in  the  training 
session,  but  showed  a  significant  drop  in  strategy  use  during  the 
transfer  sessions.    The  use  of  the  learning  strategy  was  minimal 
by  the  ID  treatment  group  tnd  almost  nonexistent  by  the  NT  group; 
this  usage  was  consistent  in  both  the  training  and  transfer 
session.    Thus  it  is  not  surprising  that  strategy  training  had  no 
significant  effect  on  performance  of  the  transfer  session 
posttests . 

Ability  was  found  to  correlate  significantly  with 
performance  (See  Table  1.05).    However,  there  was  no  significant 
difference  in  strategy  use  between  high  and  low  ability  students. 


Table  1.06  about  here. 


The  opinion  survey  indicated  a  variety  of  student 
preferences  for  lessons.    There  also  was  a  variety  of  opinions  as 
to  which  lesson  was  most  difficult.    The  majority  of  students 
placed  themselves  in  the  top  two  rankincs  of  work  effort,  "did 
their  best"  or  "good  job."    The  s'-bjects  also  seemed  to 
accurately  report  their  use,  or  more  appropriately,  their  lack  of 
use,  of  the  learning  strategy.    This  was  confirmed  by  a 
comparison  with  the  actual  scratch  paper  on  which  they  generated 
their  example . 

Discussion  and  Conclusions 

It  is  not,  of  course,  surprising  to  discover  that  in  both 
the  training  and  transfer  sessions,  higher  ability  students 
performed  significantly  better  on  posttests  than  lower  ability 
students.    The  literature  on  ability  is  replete  with  research 
findings  suggesting  that,  in  general,  higher  ability  students 
will  outperform  lower  ability  students  (Snow  &  Peterson,  1981; 
Cronbach  &  Snow,  1977).    This  study  is  in  agreement  with  that 
general  conclusion.  The  remaining  hypotheses  of  the  investigation 
were  not  supported.    Although  the  general  lack  of  significant 
results  precludes  drawing  definitive  conclusions,  some  tenative 
ones  are  warranted.  :based  on  the  findings  of  this  study. 

Training  in  Lftarning  Strategy  Ur& 

Research  on  learning  strategies  has  shown  that  students  "'n 
be  trained  in  learning  strategies  and  that  such  training  can  .ad 
to  improved  test  performance  (Weinstein  &  Mayer,  1985;  Rigney, 
1980;  Dansereau,  1985).    Howevfsr,  the  results  of  this  study 
failed  tp  demonstrate  that  such  explicit  training  enables 
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students  to  eaploy  learning  etrategiee  effectively.    This  lack  of 
support  for  the  general  consensus  on  strategy  training  may  be  due 
to  methodological  rather  than  conceptual  reasons*    In  other 
words,  it  remains  a  defensible  claim  that  training  in  learning 
strategies  may  result  in  improved  performance  on  concept  learning 
tasks,  but  specific  elements  in  the  design  of  the  lesson 
materials  and  in  the  execution  of  this  study  may  have  contributed 
to  the  lack  of  significant  results  in  the  treatments. 

Among  the  factors  that  m»y  have  contributed  to  the  failure 
to  obtain  results  are  the  following: 

1.  The  students  may  not  have  been  developmentally  ready  to 
capitalize  on  the  strategy  training*    While  research  suggests 
that  children  beyond  age  eleven  actively  engage  in  strategy  use 
(Kail,  1979;  Flavell,  1977),  these  particular  subjects  still  may 
not  have  h«id  the  mature  mental  capacity  to  engage  effectively  in 
strategy  use.    Brown  and  Smiley 's  (1977)  study  found  that  t'?elfth 
grade  students  (seventeen  years  old)  activated  strategies  to 
their  fullest  extent,  while  seventh  grade  students  (twelve  years 
old)  used  strategies  less  effectively.    Perhaps  a  sample  of  older 
students  would  have  yielded  stronger  results. 

2.  Students  may  simply  not  have  received  enough  training  in 
strategy  use.    When  one  considers  the  claim  cf  many  learning 
strategy  researchers  that  before  students  can  benefit  from 
learning  strategies  in  an  instructional  situation,  these 
strategies  jpust  first  exist  within  the  individual  (Shuell,  1980; 
Rigney,  1980),  it  is  plausible  that  a  series  of  three  lessons  may 
do  very  little  to  compensate  for  this  lack.    Students  may  not 
have  had  sufficient  time  to  acquire  the  strategy.  Perhaps 
training  sessions  of  longer  duration  may  increase  the  overall 
effectiveness  of  strategy  acquisition  and  use. 

3.  The  strategy  itself  may  not  have  contributed  to  the 
attainment  of  concepts  presented.    That  ist  despite  the  best 
effort  of  the  investigator  to  construct  a  learning  strategy  that 
directly  aided  the  attainment  of  concepts,  the  strategy 
investigated  in  this  study  may  have  produced  a  kind  of  cognitive 
overload  that  confused  rather  than  aided  the  students «  The 
generation  of  examples  may  have  competed  with  the  instructional 
task  deiriands  and  therefore  impeded  concentration.    While  research 
suggests  that  example  imagery  may  assist  learners  in  acquisition 
of  the  new  concepts  (Rosco,  et  al,  1973;  1976;  Allen,  1982),  the 
added  requirement  of  putting  the  example  on  paper  may  have 
discouraged  its  use. 

In  addition,  the  chosen  strategy  may  have  interfered  with 
strategies  already  established  by  the  subjects.    Thus,  there  may 
have  been  a  second  type  of  competition  between  the  two*    It  may 
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be  fruitful  to  explore  other  types  of  strategies  used  by 
students « 

4.    The  specific  qualities  of  the  lesson  say  have 
contributed  to  the  lack  of  significant  results.    The  '^over  mean 
posttest  scbreis  for  all  students  in  the  study  raise  the 
possibility  that  these  materials  nay  have  been  more  difficult 
than  anticipated.    Sven  though  the  difficulty  of  the  lessons  was 
adjusted I  based  on  the  pilot  study  results,  further  nodifications 
nay  be  necessary. 

Trattftfi^r  of  Learning  Stratg^v  Tse, 

Transfer,  in  general,  is  very  difficult  to  implement  and  to 
investigate  (Gagne  &  Briggs,  1978;  Clark  4  Voogel,  1985;  Gjigne, 
1986).    It  has  yet  to  be  found  conclusively  in  the  research  on 
learning  strategy  generation  and  use  (Weinstein,  1982;  Lawson, 
1980).    therefore,  failure  to  show  transfer  in  this 
investigation,  although  disappointing,  may  not  be  that 
surprising. 

1.  There  may  not  have  been  a  clear  enough  connection  for 
students  between  the  training  sessions  and  the  transfer  sessions* 
Students  may  not  have  had  sufficient  cues  vO  apply  the  learning 
strategy.    Derry  and  Murphy  (1986)  suggest  \h^t  an  unobtrusive 
prompt  be  employed  in  the  new  situations  to  cue  learners  to  u:^e 
the  2iitrategy.    Although  the  experimenter  reminded  students  to  use 
the  paper,  as  they  did  in  the  training  sessions,  and  the  scratch 
paper  itself  was     physical  reminder,  these  prompts  may  have  been 
too  vague  for  students. 

2.  Students  who  received  the  explicit  training  (ET)  on 
strategy  use  may  have  had  less  time  to  complete  the  /^ctual  lessen 
than  those  in  the  other  two  treatments..    As  an  experimental 
control,  all  treatments  h^d  the  same  amount  of  time  to  complete 
the  lessons,.    The  ET  treatment  group  had  far  more  work  to  do 
since  they  had  to  constrd&t  concept  examples  on  paper.  These 
students  Ray  have  elected  just  to  complete  the  lesso/i  task  and 
not  opt  %6  use  the  strate^;y.    Perhaps  allowing  more  time  liithin 
the  lesson  would  have  allowed  students  to  both  use  the  strategy 
and  complete  the  task. 

3.  The  results  also  indicated  a  significant  drop  in 
strategy  use  among  the  ET  group  from  the  training  sessions  to  the 
transfer  sessions.    Thus  it  may  be  necessary  to  reqt*ire  that 
sicdents  in  this  treatment  use  the  strategy  so  that  a  better 
comparison  of  performance  with  the  no  training  group  can  be 
obtained. 

4.  Finally,  the  overall  conditions  of  the  instructional 
setting  may  also  h^ve  influenced  the  outcome  of  transfer.  The 
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etudy  was  conducted  at  the  end  of  the  school  year,  when 
culminating  activities  of  the  school  and  classroom  may  have  taken 
up  much  of  the  students'  attention  and  interest.    In. addition, 
the  investigation  was  not  a  part  of  the  regular  classroom  routine 
and  students  knew  that  performance  would  not  affect  their  grades. 
These  conditions  may  have  created  artifical  setting  and 
interfered  with  students'  participation  in  the  study.  Perhaps 
incorporating  learning  strategy  training  within  the  curriculum 
would  be  more  effective. 


The  questions  examined  in  this  study  are  important  ones  for 
those  concerned  with  students'  ability  to  generate  and  use 
strategies  in  order  to  become  self  sufficient  learners.  Despite 
the  ambiguous  results  of  this  study,  it  is  possible  that  training 
in  learning  strategies  may  indeed  effectively  facilitate  the 
acquisition  ox  new  concepts.    Further  research  is  need  to 
investigate  this  claim.  Such  research  could  proceed  in  several 
directions . 

First,  a  beginning  point  for  future  research  might  be  to 
make  revisions  suggested  earlier  and  conduct  a  similar  study. 
More  reliable  measures  for  assessing  students'  performance  need 
to  be  developed.     Treatment  materials  need  to  be  revised  to 
lessen  the  difficulty  for  this  particular  age  group.  Training 
time  may  need  to  be  increased  and  the  use  of  the  learning 
strategy  might  be  required  during  the  transfer  sessions. 

Second,  further  research  should  examine  the  variations  of 
strategies  emj^loyed  by  students.     The  types  of  learning 
strategies  that  are  most  effective  with  concept  learning  need  to 
be  determined.    Subsequent  investigations  may  need  to  use 
qualitative  methods,  such  as  "think  alouds"  and  interviews,  to 
discover  the  heuristic  strategies  that  students  already  employ. 

Third,  further  research  should  investigate  the  variations  of 
strategy  training.    For  example,  the  specif xc  components  of  the 
training  need  to  be  examined  in  order  to  determine  their  impact 
on  strategy  acquisition  and  use.     Studies  might  investigate  the 
examples  used  in  demonstrating  a  particular  strategy,  or  the 
amount  of  practice  necessary  for  student  to  acquire  the  strategy, 
or  the  amount  and  type  of  feedback  used  in  the  training  of 
strategy  use. 

Fourth,  longitudinal  studies  are  needed  to  investigate  the 
effect  of  extended  training  in  strategy  use  on  students' 
acquisition  of  new  concepts.    This  might  be  conducted  in  the  form 
of  experimental  curricula  that  incorporates  strategy  training 
within  a  content  area.    It  might  be  necessary  to  train  teachers 
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in  etrntegy  use  in  order  to  incorporate  the  investigation  within 
a  regular  classroom  situation. 


Fifth,  further  investigation  should  be  made  into  the 
relationship  between  ability  and  strategy  training-  This 
research  night  supply  answers  to  inquiries  about  how  strategies 
can  better  serve  lower  ability  students  without  hindering  higher 
ability  students  who  may  already  possess  strategies  and  use  them 
effectively.    In  addition,  studies  need  to  consider  ^he  effects 
of  strategy  training  on  the  middle  range  of  ability  as  well  as 
the  extremes •    Such  a  study  could  provide  practical  information 
in  how  to  implement  strategy  training  into  the  more  typical 
classroom  setting. 

Sixth,  because  the  investigation  of  interactions  of  strategy 
training  and  individual  differences  is  a  new  area  of  research 
(Dansereau,  1985),  no  definitive  conclusions  could  be  made  from 
the  findings  of  the  present  investigation.    However,  it  is  a 
beginning.    More  research  is  needed  on  the  effects  of  strategy 
training  and  uses  as  they  relate  to  other  learner 
characteristics . 

Finally,  continued  efforts  need  to  be  made  to  understand  the 
transfer  effect  of  strategy  training.    A  study  could  be  devised 
to  investigate  the  type  of  prompting  needed  to  envoke  strategy 
use  in  new  situations-    The  amount  and  the  duration  of  prompting 
are  also  important  factors  to  be  investigated. 

In  summary,  the  variations  and  extensions  the  study  just 
described  imply  directions  for  future  research.     Such  studies 
could  suggest  ways  to  train  student  to  use  strategies 
effectively,  and  thus  become  self  sufficient,  competent  learners. 
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Figure  1.01 

Schedule  for  the  Training  and  Transfer  Sessions 
Sesslonst  Training  Transfer 
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«  No  lessons  In  Session  6;  only  tests  and  opinion  survey. 

LESSONS:    PP  «  Prepositional  Phrases  TESTS:  0  «  no  test  given 

CL  «  Clouds  1  *  lesson 

PT  »  Propaganda  Techniques  2  «  Immediate 

CC  =  Context  Clues  3  «  delayed 

MS  »  Hollusk  Shells  4  «  retention 
CN  «  Content  Narratives  on  same  topic 
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Table  i.oi 

Means  and  Standard  Deviations  for 
Performance  Measures  for  Training  Session  Lessons 


Lesson 
Post tests 

ET 

Treatments 
ID 

Total 

irroposi  V 1  ona  i 

Phrases^ 

n 

6.2 

5.5 

5.9 

SD 

1.7 

1.5 

1.6 

n 

47 

46 

93 

7.0 

6. 1 

6.6 

SD 

2.7 

2.7 

2.7 

n 

47 

46 

93 

Propaganda 

Techn  i  ques«« 

M 

6.7 

6.4 

6.6 

SD 

2.3 

2.4 

2.4 

n 

58 

60 

118 

#    Maximum  score  »  10  items  on  the  post  test. 
Maximum  score  «  12  items  on  the  post  test. 
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Tablt  1.02 


Means  and  Standard  Deviations 
for  Test  Scores  for  the  Context  Clues  Lesson 


Treatments 

Test  ET  ID  HT  Total 


Xninedlate 
Posttest  in 


M 

10.4 

10.1 

10.5 

10.3 

SD 

2.9 

3.4 

3.1 

3.1 

n 

55 

50 

51 

156 

Delayed 

Posttest  X# 

H 

9.3 

10.1 

10.0 

9.8 

SD 

4.0 

3.8 

4.2 

4.0 

n 

55 

50 

51 

156 

Retention 

Test  I# 

H 

9.3 

3.9 

10.0 

9.4 

SD 

3.1 

3.1 

3.0 

3.1 

n«« 

27 

22 

26 

75 

«  Maximum  score  »  20  items  per  test 
Numbers  show  that  approximately  half  of  the  subjects 
were  randomly  'jampled  within  each  treatment  group  to 
complete  the  test. 
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Tablt  1.03 


MeAns  and  Standard  Deviations 
for  Test  Scores  for  Mollusk  Shells  Lesson 


Treatments 


Tests 

ET 

IS 

NT 

Total 

Iinnedlate 

rO8tt09w  lin 

H 

9.1 

9.0 

8.7 

9.0 

SD 

4.2 

3.  r 

o .  o 

n 

Delayed 

Post  test  link 

n 

8.8 

8.7 

8.3 

8.6 

SD 

4.2 

3.5 

3.5 

3.7 

n 

55 

50 

51 

156 

Retention 

Teat  II« 

• 

M 

7.9 

7.4 

8.8 

8.1 

SD 

3.9 

3.5 

3.5 

3.6 

n»» 

27 

26 

25 

78 

«  Maximum  score  «  20  item^.  per  test 
««  Numbers  show  that  approximately  half  of  the  subjects 
were  randomly  sampled  within  each  treatment  group  to 
complete  the  test. 


196 

203 


Table  1.04 


Pearson  Product*No(nent  Correlations 
Among  Cognitive  Skills  Index  &  Performance  Measures 


TEST 

PPL 

CL     PTL    CCI     CCD  CCR 

MSI 

HSO 

HSR 

Cognlt^ a 

Skills 

Index 

.32a     .50     .48     .46     .35  .29 
(105}b  (111)  (110)  (162)  (158)  (  74) 
.001c   .001   .001   .001    .001  .007 

.51 
(163) 
.001 

•  50 
(158) 
.001 

•  35 
(  75) 
.001 

Prepositional 

Phrase 

Leison 

.34     .29     .25     .25  06 
(111)  (110)  (105)  (103)  i  45) 
.001   .001   .004   .006  .35 

.27 
(109) 
.003 

.34 
(106) 
.001 

.22 
(  52) 
.06 

n  oiiHc 

U 1 UUUd 

Lesson 

32       32       26  27 
(117)  (114)  (109)  (  51) 
M   .001   .003  .03 

.47 

(116) 
.001 

.40 

(113) 
.001 

.55 
(  52) 
.001 

Propaganda 
Techniques 
Lesson 

.41     .40  .40 
(114)  (108)  (  50) 
.001    .001  .002 

•  36 
(115) 
.001 

.40 
(112) 
.001 

.33 
(  52) 
.008 

Context 

Clues 

Immediate 

.51  .58 
(163)  (  77) 

.001  .001 

.3/ 
(168) 
.001 

•  3o 
(163) 
.001 

•  44 

(  77) 
.002 

Context 

Clues 

Delayed 

.48 

(  78) 
.001 

(163) 
.001 

•  35 
(158) 
.001 

•  4Z 

(  72) 
.001 

Context 

Clues 

Retention 

.13 
(  78) 
.125 

.01 
(  78) 
.47 

N/A 

Moll  us k 

Shells 

Immediate 

.56 

(167) 
.001 

.63 

(  78) 
.001 

MollufJc 

Shells 

Delayed 

.69 
(  77) 
.001 

,  «  Pearson  Correla^.ion  Coefficient 
J  «  number  of  subjects 
*  p  value 


N/A  «  Different  subject  samples  for  each  test 
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Table  1.05 


Univariate  Analyses  of  Ability  Effects 
on  Performance  Measure  Scores 


Test  HS  OF  F  ?-value 
Prepositional 

Phrase  2.15  Cl,99>  12.31  <.001 

Clouds  5.38  Cl,99>  35.76  <.001 
Propaganda 

Techniques  4.41  Cl»99>  29.16  <.001 

Context  Clues 

Ininediate  I  7.49  Cl,145>  43.65  <.001 

Delayed  I  14.00  Cl,145>  22.46  <.001 

Retention  I  59.66  Cl,70>  6.92  .01 

Mollusk  Shells 

Inmediate  II  10.57  CI. 145)  51.58  <.001 

Delayed  II  11.03  Cl,145>  44.85  <.001 

Retention  II  129.93  Cl,71>  11.22  .001 
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PlLM-waJCERS  AND  PERSUASIVE  FILMS:     A  Study  to  Determine  How  Persuasive 

Films  are  Produced 


*'...it  can  be  argued  that  a  majority  of  our  educators  have  more 
in  common  with  persuaders  than  they  realize.     The  truly  educational 
film  must  not  only  answer  questions  but  question  answers."  {Rose^ 
1962) 

Attitude  formation  and  change  are  important  educational  goals. 
Educators  are  faced  with  the  need  to  urge  learners  to  accept  certain 
points  of  view^  and  to  promote  certain  attitudinal  positions.     If  a 
fundsunental  goal  of  education  is  to  question  what  is  generally 
accepted^  then  the  function  of  the  persuader  in  society  might  be  to 
urge  acceptance  of  that  which  has  been  questioned.    Whether  it  is 
realized  or  not,  educators  are  constantly  advocating  one  position  in 
preference  of  another  (Rose^  1962) . 

The  field  of  education  deals  directly  with  persuasive  messages. 
The  educator's  method^  in  theory^  is  to  give  an  unbiased  presentation 
of  the  relevant  facts  known  about  a  process  or  a  situation  and  then  to 
let  the  learner  judge.     The  acceptance  or  rejection  of  an  idea  is 
theoretically  based  on  the  learner's  prior  knowledge  and  the  ability 
to  evaluate  evidence. 

Since  World  War  11^  when  films  were  used  to  teach  millions  of 
G.I.'s  topics  such  as  the  basics  of  hygiene^  operation  of  the  M-1 
rifle^  or  the  procedures  for  bracketing  with  mortar  fire^  the  training 
film  has  been  a  popular  and  useful  tool  to  the  educator.     The  purpose 
of  a  film  is  based  on  one  of  the  following:     enlightenment ^ 
entertainment^  or  persuasion  (Rose^  1963) .    Educational  films  must 
catch  the  interest^  arouse  feelings^  and  involve  the  student 
emotionally  in  some  way  if  the  film's  idea  is  to  become  an  intimate 
functional  part  of  the  student's  perception  and  thinking.  An 
educational  film  will  teach  very  little  if  the  student  is  merely  a 
passive  onlooker  (Ashiem^   1955) . 

The  persuasive  film  is  different  from  other  categories  of  motion 
pictures  because  it  is  designed  with  attitude  formation  and  change  as 
its  primary  purpose.     They  attempt  to  involve  the  viewers'  attitudes 
into  a  message  in  order  to  influence  them.    While  most  films  are 
designed  with  some  persuasive  elements^  a  persuasive  film  is  defined 
as  one  where  attitude  change  is  the  single  most  important  goal  of  the 
motion  picture^  and  where  entertainment  or  enlightenment  are  included 
only  to  contribute  to  the  ultimate  goal  of  persuasion  (Simonson^ 
1981)  . 

The  importance  of  attitude  research  is  often  based  on  the 
relationship  between  attitudes  and  achievement.     It  has  been  difficult 
for  educational  researchers  to  identify  a  direct  correlation  between 
the  two  because  of  the  many  external  influences  on  both.  However^ 
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there  have  been  a  number  of  researchers  who  have  identified  a  positive 
link  between  "liking  and  learning"  (Fenneman^  1973;  Greenwald^  1965^ 
1966;  Levy^  1973;  Simonson^  1977;  and  Simonson  &  Bullard^  1978^  for 
excunple)  . 

How  attitude  affects  learning  is  only  one  reason  to  measure 
attitudes.     There  are  other  reasons  why  it  is  important  to  know  how  to 
persuade.     There  are  times  when  it  is  important  to  promote  a  certain 
attitudinal  position  and  encourage  students  to  accept  the  "truth"  of 
certain  ideas.    Also^  educators  need  to  have  an  idea  of  the  techniques 
that  affect  attitudes  of  learners  in  order  to  avoid  influencing  them 
at  undesirable  times  (Fleming  &  Levie^  1978)  . 

Since  Thurstone's  landmark  study  in  1931  that  demonstrated  films 
were  capable  of  producing  attitude  changes  in  children^  many 
experiments  have  been  conducted  to  study  the  relationship  between 
instructional  media  and  attitude  formation  or  change  in  learners. 
Niamerous  studies  have  shown  that  films  have  influenced  children.  In 
1933^  Peterson  and  Thurstone's  study  demonstrated  that  films  changed 
children's  attitudes^  making  them  consistent  with  the  values  presented 
in  the  films.     Levonian  (1960^  1962^  1963)     reported  that  a  persuasive 
film  on  India  produced  a  significant  positive  attitude  change  in 
viewers.     Still  more  studies  that  found  films  could  produce  attitude 
change  were  reported  by  Allison  (1966^  on  science) ^  Greenhill  (1957)^ 
Alese  (1973)  and  Reid  (1970) . 

In  1979^  Simonson  published  a  list  of  six  guidelines  that/  if 
included  in  the  planning^  production^  or  use  of  mediated  instruction^ 
would  contribute  to  the  development  of  desired  attitudinal  outcomes. 
These  guidelines  were  based  on  results  gathered  from  over  one  hundred 
research  studies  on  attitudes  and  media.     Establishing  the  guidelines 
was  one  of  the  first  steps  toward  the  development  of  exact  processes 
needed  for  producing  mediated  messages  with  persuasion  in  mind. 

Simonson' s  guidelines  were  used  to  propose  techniques  that  could 
be  used  in  mediated  messages.    Previously ^  there  was  little  definitive 
information  available  in  the  literature  concerning  the  specific 
procedures  used  in  persuasive  instruction ^  especially  for  persuasive 
films.     It  can  be  said  that  educational  films  persuade  viewers  to 
agree  with  certain  ideas^  however^  the  techniques  used  by  film-makers 
in  the  production  of  persuasive  motion  pictures  that  affect  attitudes 
have  not  been  systematically  identified^  examined^  and  categorized. 
There  has  not  been  any  comparison  between  what  researchers  say  are  the 
procedures  for  persuading  and  what  film-makers  do  when  persuasion  is 
their  goal. 

In  1981/  Simonson  reported  on  a  survey  of  award-winning 
film-makers  who  were  asked  to  explain  the  techniques  they  used  when 
they  planned  and  produced  persuasive  instructional  films.    A  number  of 
specific  techniques^  directly  related  to  Simonson' s  (1979)  six 
guidelines^  were  identified.     However^  a  low  questionnaire  return  rate 
made  generalizations  about  the  results  inappropriate.     The  study 
reported  in  this  paper  is  a  modified  replication  of  Simonson' s  1981 
study.    Most  procedures  were  repeated.    However ^  a  rigorous  series  of 
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follow-up  steps  were  followed  in  order  to  maximize  the  number  of 
questionnaires  returned. 

The  purpose  of  this  study  was  to  determine  what  procedures  are 
used  by  successful  film-makers  when  they  plan  and  produce  persuasive 
educational  films, 

METHODOLOGY 


Sample 

In  order  to  obtain  information  from  film-makers  about  persuasive 
films,  a  list  of  professional  cinematographers  was  needed.     Since  the 
Council  on  International  Non-Theatrical  Events  (CINE)  lists 
film-makers  who  have  received  awards,  a  current  CINE  catalog  was  used 
to  obtain  names  of  "successful"  film-makers.     Since  the  purpose  of 
this  study  was  to  ask  film-makers  who  were  experienced  in  persuasive 
film-making  to  evaluate  techniques,  and  since  the  nature  of  this  study 
was  descriptive,  a  random  selection  of  film-makers  was  not  considered 
necessary.     Only  film-makers  who  had  "successfully"  produced  films  are 
listed  as  Golden  Eagle  Award  winners  in  the  CINE  catalog.  Golden 
Eagle  Award  winning  film  producers  were  the  target  population  for  the 
3tudy • 

Approximately  two  hundred  film-makers  listed  as  Golden  Eagle 
award  winners  were  sent  a  copy  of  the  Film  Maker  Survey  (FMS)     with  a 
cover  letter'  explaining  the  purpose  of  the  study.     These  film-makers 
were  chosen  because  the  descriptions  of  their  films  in  the  CINE 
catalog  seemed  to  indicate  thc;t  their  motion  pictures  were  persuasive 
in  nature. 

THE  FMS 

In  Simonson's  1981  study,  an  analysis  of  the  characteristics  of 
those  film-makers  who  completed  the  survey  as  con5)ared  to  those  who 
did  not  return  it,  failed  to  reveal  any  significant  relationships  that 
might  have  indicated  that  a  biased  subset  of  film-makers  answered  the 
(FMS)  as  compared  to  those  who  did  not.    However,  the  return  rate  of 
approximately  34%  was  considered  too  low  to  permit  generalizations  of 
results.     In  spite  of  the  low  return  rate,  it  was  determined  that  the 
FMS  was  an  appropriate  measure  of  film-maker  opinions.     It  had 
produced  consistent  and  usable  results  in  1981,  and  its  questions 
could  be  related  directly  to  the  guidelines  for  producing  persuasive 
instructional  messages.     The  content  of  the  questionnaire  remained 
generally  the  same,  and  only  revisions  in  format  and  structure  were 
made. 

The  questionnaire  was  divided  into  two  parts.     Part  One  dealt 
with  the  background  and  experience  of  the  film-maker.    Part  Two  had 
the  film-makers  rate,  discuss,  or  evaluate  techniques  used  in 
persuasive  film-making.     Each  question  in  Part  Two  of  the 
questionnaire  was  related  to  one  of  the  six  guidelines  for  attitude 
change  identified  by  Simonson  (1981) . 
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Verification  and  Distribution  of  the  Questionnaire 


Revisions  on  the  questionnaire  were  minor.    A  cover  letter  was 
written  to  explain  the  purpose  of  the  study.     The  questionnaire  was 
designed  to  be  folded,  stapled  and  returned  by  mail  (postage-paid) . 
Four  weeks  after  the  first  mailing  a  second  mailing  was  distributed  to 
non-re sponder s .     Two  weeks  after  the  second  follow-up,  a  reminder 
postcard  was  mailed  to  non-respondents . 

Those  film-makers  who  had  not  responded  at  the  end  of  a  month 
were  randomly  sampled.     Twenty  film-makers  were  identified  as 
representative  of  the  non-*re spending  group.     The  sample  were 
interviewed  on  tne  telephone  and  asked  to  return  the  questionnaire  in 
the  next  few  days.     The  results  of  questionnaires  completed  by  this 
group  of  non-responding  film-makers  were  compared  to  the  results  of 
the  responding  film-makers  to  determine  if  the  non-responding  subjects 
answered  the  questions  in  about  the  same  manner  as  the  responding 
group.     There  were  no  significant  relationships  that  might  have 
indicated  that  a  biased  sxabset  of  film-makers  answered  the  FMS  as 
compared  to  those  who  did  not.    A  total  of  eighty-seven  questionnaires 
were  returned  for  a  return  rate  of  forty-four  per  cent . 

The  data  collected  were  used  to  determine  film-maker's  perceptions 
of  the  techniques  used  in  the  planning  and  production  of  persuasive 
films.     The  ratings  of  the  techniques  were  tabulated,  and  where 
appropriate,  rank  orders  were  established.     First,  all  descriptive 
statistics  were  obtained  for  each  question.     This  included  average 
scores,  standard  deviations  of  scores,  and  the  number  responding  to 
each  question.    Next,  correlations  between  all  relevant  variables  were 
computed.    Last,  more  in-depth  analyses  of  data  determined  to  be 
interesting  based  on  the  descriptive  statistics  were  conducted. 

RESULTS 

Profile  of  Respondents 

Ninety-five  percent  of  the  responding  film-makers  indicated  that 
film-making  was  their  primary  occupation.     Approximately  sixty-eight 
(67.8%)  percent  of  the  film-makers  classified  themselves  as 
producer/director,  19%  were  producers,  2%  were  directors,  and  ten 
percent  responded  to  the  "Other"  category.     The  majority  of  the 
respondents  who  chose  the  "other"  category  were  classified  as  writers. 

The  average  length  of  time  a  respondent  had  been  in  the 
film-making  profession  was  about  18  years.     The  range  was  from  three 
to  fifty  years.     Seventy-nine  percent  of  the  respondents  were  males. 
The  average  age  of  all  respondents  was  forty-five.     The  range  from 
youngest  to  oldest  was  twenty-eight  to  seventy-four  years . 

Fifty-four  percent  of  the  film-makers  indicated  they  had  some 
type  of  formal  training  in  film-making,  and  a  little  over  forty-three 
percent  had  only  on-the-job  training.     Almost  fourteen  percent  of  the 
sample  had  less  than  one  year  of  formal  training.  Approximately 
twenty  percent  had  between  one  and  two  years  of  formal  training;  two 
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percent  indicated  between  two  and  three  years  of  training^  ten  percent 
responded  that  they  had  a  bachelor's  degree^  and  eleven  percent  had 
master's  degrees^  or  more^  in  film-making.     Only  seventeen  percent 
reported  having  had  some  sort  of  training  in  the  techniques  and 
theories  of  persuasion. 

The  average  number  of  films  of  all  types  produced  by  each 
film-maker  was  approximately  102.     The  number  of  films  produced  ranged 
from  one  to  one  thousand.     The  average  number  of  persuasive  films 
produced  by  the  average  film-maker  was  67. 

The  average  number  of  Golden  Eagle  Awards  (the  highest  award 
given  by  CINE)   for  films  of  all  types  received  by  responding 
film-makers  was  6.     The  average  number  of  Golden  Eagle  Awards  received 
for  persuasive  films  was  5.     Film-makers  reported  that  the  average 
length  of  their  persuasive  films  was  24  minutes.     Films  ranged  in 
length  from  ten  minutes  to  sixty  minutes. 

The  definition  of  persuasive  film  used  in  this  study  was 
considered  appropriate  by  eighty-five  percent  of  the  film-makers. 
Film-makers  were  nearly  equally  divided  when  asked  their  feelings 
concerning  the  market  for  persuasive  films.     Twenty-four  percent  of 
the  film-makers  surveyed  felt  that  fifty-one  to  seventy-five  percent 
of  the  film  market  was  for  persuasive  films  rather  than  informative 
films. 

Persuasive  Film  Production  Techniques 

One  of  the  major  goals  of  this  study  was  to  determine  how 
film-makers  would  go  about  producing  a  film  when  persuasion  was  their 
goal.    Film-makers  responding  to  the  FMS  indicated  that  they  felt  a 
formal  prescript  writing  target  audience  assessment  was  important  in 
the  production  of  persuasive  films  (X  =  4.4;  5  =  very  important^  1  = 
very  unimportant) .     Fifty-seven  percent  of  the  respondents  indicated 
they  felt  persuasive  films  were  planned  and  produced  differently  than 
other  educational  films  and  the  degree  of  difference  ranged  between 
very  different  to  somewhat  different  (X  =  1.80;  1  =  very  different/  5 
==  almost  the  same)  . 

In  order  to  determine  which  production  techniques  were  considered 
most  effective  for  persuasive  films^  film-makers  were  asked  their 
opinion  on  the  importance  of  a  number  of  techniques.     The  same 
techniques  were  rated  in  several^  different  questions  by  respondents 
in  order  to  validate  ratings  and  to  determine  what  production 
techniques  were  considered  most  effective  for  persuasive  films.  An 
analysis  of  these  ratings  follows. 


WHEN  COMPARING  PERSUASIVE  FILM-MAKING  TO  OTHER  FILM-MAKING,  HOW 
IMPORTANT  IS  IT  TO   

very  important  1.     use  motion  in  the  filmed  action 

2.    present  new  information 
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very  unimportant 


3.  use  believable  or  realistic  scenes 

4.  use  an  arousing  or  dramatic  musical 
score 

5.  use  color 

6.  produce  a  shorter  film  rather  than 
longer  film 

7.  use  many  cuts/scenes  rather  than  few 

8.  use  physically  attractive 
actors/actresses 


HOW  WOULD  you  RATE  THE  FOLLOWING  IN  INFLUENCING  ATTITUDES  OF 
VIEWERS  IN  PERSUASIVE  FILMS? 


most  effective 


least  effective 


1.  conduct  a  target  audience  pre-planning 
assessment 

2.  Have  actors/people  in  the  film  similar 
to  the  target  audience 

3.  present  inspirational  messages 

4.  include  a  teacher's  guide  with 
follow-up  questions 

5.  Use  testimonials 

6.  use  professional  actors 

7 .  use  a  big  name  star  to  promote 
the  position 

8.  use  graphs,  charts  and  other  visual 
methods  for  presenting  facts 

9.  present  verbal  information  visually 
through  title  scenes 


RATE  THE  FOLLOWING  TECHNIQUES  IN  ORDER  OF  THEIR  IMPORTANCE  IN  THE 
PRODUCTION  OF  PERSUASIVE  FILMS. 


effective  techniques 


1.     "Arouse"  the  audience  intellectually, 
sexually,  or  emotionally 

2.  Make  the  film  "fun"  to  watch 

3.  present  factual  information 
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4.  be  as  "nonverbal"  as  possible 

5.  present  both  sides  of  an  argument 

6.  use  "talking  faces" 


7 »    use  "animation" 


8.     "scare"  the  audience  by  presenting  the 
consequences  of  not  following  the 
1  recommendations  of  the  film 

not  effective 

techniques  9.    use  many  title  scenes 

The  film-makers  generally  agreed  that  conducting  a  target  audience 
assessment  and  arousing  the  audience  in  some  way  were  the  most 
important  persuasive  film  techniques.     In  another  question^ 
film-makers  ranked  three  statements  about  strategies  in  film 
production  in  order  of  importance.     Of  the  three^  the  arousal  of 
viewers  emotions  was  reported  to  be  most  important.     Technical  quality 
was  listed  as  next  in  importance^  and  the  presentation  of  new 
information  was  listed  as  least  important  of  the  three. 


Almost  forty  (39.1%)  percent  of  the  film-makers  felt  it  was 
exciting  to  produce  a  persuasive  film  rather  than  other  kinds  of 
educational  films  (X  =  4.1;  1  =  very  unexciting^  5  «  very  exciting). 
Half  of  the  film-makers  reported  that  they  always  believed  in  the 
message  of  the  films  they  produced.     Twenty-one  percent  thought  the 
message  was  usually  correct  and  twenty-one  percent  reported  some 
messages  affect  them  and  some  did  not;  one  indicated  he  never  became 
involved  with  the  content  of  his  films. 

The  sample  felt  that  their  persuasive  films  were  relatively 
effective  at  changing  attitudes  of  viewers  (X  =  3.83;  5  =  very 
effective^  3  =  somewhat  effective^   1  -  very  ineffective)  .     Over  hc,\f 
(67.8%)   of  the  responding  film-makers  indicated  there  was  a  need  for 
more  information  concerning  techniques  in  persuasive  film  production. 

Fil^n-makers  were  asked  if  they  ever  evaluated  the  impact  of  their 
films.     Seventy-eight  percent  of  those  responding  said  they  had 
evaluated  the  effectiveness  of  the  persuasive  films  they  produced. 
The  following  methods  for  determining  effectiveness  were  given: 

Response  #  of  film-makers  who  used 

technique  (n  =  68) 

1.  comments  from  viewers  ^  56 

2.  results  from  contests  45 

3.  informal  surveys  41 

4.  sales  37 
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5. 


comments  of  other  film-makers 


29 


6. 


intuition 


25 


7. 


formal  experimentation 


15 


8. 


other 


11 


SxMnmary  of  Results 

Those  film-makers  who  responded  to  the  survey  produced  a 
consensus  on  several  techniques  and  strategies  that  they  felt  were 
important  in  the  production  of  a  persuasive  film.    Arousing  the  viewer 
either  emotionally  or  intellectually  and  basing  the  film  on  an 
audience  pre-assessment  were  considered  important  by  the  majority  of 
the  responding  film-makers.     Other  techniques  that  were  listed  as 
somewhat  important  were: 

making  the  film  "fun"  to  watch 

assessing  the  target  audience 

using  actors  that  were  similar  to  the  target  audience 

using  written  teacher's  guides  and  follow-up  discussions 

using  realism  that  was  relevant  to  the  viewer 

Techniques  that  were  generally  not  considered  effective  or 
important  in  persuasive  films  were: 

using  title  scenes 

using  animation 

"scaring"  the  audience 

using  talking  faces 

using  charts  and  graphs  to  present  facts 

using  attractive  actors 

using  many  cuts/scenes 

It  is  interesting  to  note  that  67.8%  of  the  respondents  felt  there  was 
a  need  for  more  information  about  the  production  of  persuasive  films. 
This  survey  identified  some  of  the  techniques  film-makers  used  when 
producing  motion  pictures,  and  several  techniques  that  they  felt  were 
effective  for  changing  attitudes  of  viewers. 

Film-makers  were  also  asked  to  list  the  title  of  a  persuasive 
film  they  felt  was  exemplary.     The  sixty-nine  film-makers  that 
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responded  to  this  question  each  listed  one  film.    Of  the  sixty-nine 
films  listedr  only  five  films  were  listed  more  than  once.    Each  of  the 
five  films  were  only  listed  twice.    Those  films  that  were  listed  twice 
were: 

Harlan  County  Triumph  of  the  Will 

War  Games  Dark  Circles 

China  Syndrome 

It  was  interesting  to  note  that  two  of  the  five  films  that  were  listed 
more  than  once  were  full  length  features  that  were  box  office 
successes. 

Since  Simonson's  1981  study  had  a  low  return  rate  (34%),  one  of 
this  study's  objectives  was  to  obtain  a  higher  rate  of  return.  The 
fact  that  only  forty-four  percent  of  the  sample  returned  the  survey 
was  a  concern.    The  unique  personality  of  film-makers,  the  mobility  of 
members  of  the  film-making  profession,  and  the  large  number  of  address 
changes  contributed  to  the  rather  low  rate  of  return. 

Comments  from  film-makers  on  the  surveys  that  were  returned  added 
information  about  the  low  rate  of  return.    Responses  seemed  to 
indicate  an  unwillingness  to  agree  that  a  set  of  guidelines  could  be 
developed  for  persuasive  film-making.    The  overall  feeling  of  the 
several  film-makers  who  wrote  comments  was  that  this  survey  only 
"touched  the  surface"  of  a  complicated  subject.    Also,  film-makers 
seemed  to  be  reluctant  to  reveal  techniques  or  procedures  that  have 
be^-n  si^ccessful  for  them  because  of  the  highly  competitive  nature  of 
film-making.    Success  is  often  achieved  in  motion  picture  production 
because  of  the  use  of  a  unique  or  creative  new  technique.    By  sharing 
their  discoveries  other  film-makers  might  become  equally  successful 
therefore  reducing  any  advantage  a  film-maker  might  have.    Some  of 
these  "artists"  might  have  felt  that  a  knowledge  of  what  makes  them 
"tick"  would  somehow  destrov  their  magic  powers  of  creativity  (Rose, 
1963)  . 

The  results  and  conclusions  of  this- study  are  not  a  recipe  for 
the  development  of  persuasive  messages,  but  are  a  guide  for  further 
research.    As  one  film-maker  said,  "It  is  often  misleading  or  risky  to 
accept  generalities  drawn  from  surveys  and  turn  the  findings  into 
absolute  rules  that  govern  the  making  of  a  single  film."  Other 
comments  described  film-making  as  "an  extremely  subjective  medium," 
and  "a  very  complex  and  interesting  subject."    These  comments  from  the 
responding  film-makers  may  be  evidence  of  the  need  for  a  more 
scientific  approach  to  the  investigation  of  the  art  of  persuasive 
film-making. 

"For  it  is  only  when  the  doer  matures  enough  to  want  to 
understand  why  he  does  what  he  does,  more  than  just  intuitively  or 
impulsively,  can  he  consciously  and  systematically  hope  to  raise  the 
standard  of  his  art  to  new  heights.    Until  such  answers  become  clear 
the  film  maker  can  only  play  a  game  of  trial  and  error.  Once 
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understanding  enters  the  process  the  way  is  paved  for  a  marriage 
between  the  science  and  the  art  of  cinema"  (Rose,  1963) . 
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Next  Generation  2 


CHARACTERISTICS  OF  COGNmVE  INSTRUCTIONAL  DESIGN: 
THE  NEXT  GENERATION 


Tliis  discussion  begins  with  the  assunsption  that  cognitive  psychology  can  make  significant 
contributions  to  (be  develc^ment  of  the  next  generation  of  instructional  systems  (for  simplicity,  the 
term /'instructional  systems"  will  be  used  to  define  both  instructional  design  theories  and  models). 
Much  is  known  about  informaticm  processing  and  cognitive  science  diat  could  be  at  least  considered, 
if  not  incoiporated,  into  existing  systems  to  produce  moro  efifective  systems.  A  second  fundamental 
assumption  to  this  discussicm  is  diat  the  number  of  instructional  systrais  currently  available  serve 
useful  functions  in  guiding  instrocticm.  At  present,  litde  change  in  the  macrostmctures,  or 
framewoiics,  of  the  various  systems  appears  needed  Instead,  major  change  is  encouraged  in  the 
microstructuies  of  instructional  systems  —  those  aspects  of  instraction  which  directly  afifect  the 
learner. 

Current  trends  in  educational  technology  during  the  last  few  years  have  begun  to  focus  on 
cognitive  rather  than  behavioral  aspects  of  learning  (Case  &  Bereiter,  19S4;  Gagne',  1987;  Gagne'  & 
Dick»  1983;  Reigelutlu  1983).  In  tfiis  discussion,  several  ideas  will  be  presented  to  reinforce  and 
strengthen  this  shift  in  perspective.  Hie  primary  purpose  of  this  discussicm  is  to  present  an  overview 
of  useful  aspects  of  cognitive  psychology  which  can  be  immediately  inq)lemented  by  instructional 
designers.  Lastly,  a  cognitive  instructional  design  will  be  presented  to  help  current  designers 
incoipcHrate  tfiese  cognitive  principles.  This  cognitive  instructicmal  design  is  not  meant  to  be  added  to 
the  large  number  of  existing  models,  but  rather  to  be  used  a  supplement  or  adjunct  to  existing  models. 


Instructional  design,  as  with  other  curricular  matter;,  is  not  singly  an  all  or  none  matter.  It 
becomes  considerably  complicated  by  the  purposes  to  be  served  by  the  instmction.  For  example, 
different  procedures  must  be  followed  when  instmction  is  for  training  relatively  single  processes, 
such  as  learning  of  verbal  information,  as  compared  to  tte  processes  needed  in  problem-solving. 

In  many  training  situations  involving  sin^)le  processes,  such  as  frequently  found  in  lower-level 
learning,  the  learning  objectives  can  be  clMcd  (prescribed  and  well-defined).  Here  learning  is 
algorittmiic,  that  is,  there  are  certain  prescribed  steps  to  be  followed.  Only  behavioral  statements  of 
goals  and  performance  aro  leqmred  The  primary  function  Oi  instmction  is  to  guide  die  leamer's 
intenticms  and  expectations  regarding  tfie  goal  standards.  There  are  certain  prescribed  steps  to  be 
followed  and  these  have  but  to  be  acquired  and  retained  until  action  is  taken. 

When  the  instmctional  goal  involves  hi^er-level  learning  such  as  comprehension, 
understanding,  decision-making,  and  problem-solving,  then  the  complexly  of  instmctional  practices 
takes  a  quantum  leap  fimn  the  reqdranents  of  a  simple  application.  The  framework  of  the 
instmcticmal  system  might  contain  many  of  the  same  elements  involved  in  guiding  lower-level 
learning,  but  the  impleroentadon  at  any  oac  stage  involves  numerous  alternatives.  There  is  a  need  to 
consider  bodi  declarative  and  procedural  knowledge.  The  objectives  are  open  rather  than  closed. 
Open  objectives  do  not  have  a  ready  basis  for  evaluation  and  may  not  be  easily  predetomined.  There 
may  be  a  host  of  sub-objectives,  some  of  wttich  may  correspond  to  prerequisite  knowledge.  In 
addition,  the  tiiought  processes  tiiat  students  use  in  instmction  interact  so  complexly  with  demands, 
goals,  intentions,  and  expectations  that  these  processes  are  not  easily  identifiable.  Rather  than 
learning  simply  to  implement  a  procedure  the  student  must  acquiro  die  alnli^  to  recognize  patterns,  to 
use  context  in  determining  course  of  action,  to  discriminate  among  patterns,  to  generalize,  to 
understand,  and  to  explain  what  has  been  learned.  To  complicate  the  matter  further,  the  order  of 
events  may  change  from  one  occasion  to  anotha:,  that  is,  althougli  there  may  be  an  overall  desirable 
sequence,  on  many  occasions  recursive  mles  (to  use  but  one  example)  may  be  appropriate. 


Premises  and  Assumptions  of  a  Cognitive  Approach  to  Instmctional  Design 
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Instruction  involving  higher  levels  of  learning  should  en[q)hasize  a  debugging  process  where 
sources  of  taar  provide  useful  information  for  implementaticm  of  remediation  or  repair  strategies. 
Some  repair  is  always  necessary  in  comprehension  monitoring  when  the  learner  detects  faulty 
reascming  patterns,  tte  use  of  incorrect  rules,  a  poor  solution  to  the  problemi,  lack  of  understanding, 
or  failure  to  ccwQpiehend  a  word  or  text  The  instruction  needs  to  consider  (pr  anticipate)  what  the 
learner  is  ^ing  (or  mi^t  be  doing)  at  each  critical  decisicm  point  This  can  be  reduced  to  three  main 
parts:  what  is  the  knowledge  base  of  the  learner  (prior  knowledge);  what  strategy  the  learner  has 
decided  to  use  to  acquire  the  skilU  ability,  or  knowledge;  and  whetiier  the  strategy  is  appropriate  to 
a^eve  the  intentions  and  goals  of  &e  instructicm.  All  of  tiiese  require  effective  self-monitoring 
Eternal,  or  leamer*driven)  which  tiie  instruction  can  pronq>t  (extomal,  or  instruction-drivra).  This 
is  the  debugging  process  and  is  dependent  upon  an  un^rstanding  of  the  instructional  goals.  When 
ertors  are  made  they  provide  inqxxrtant  indications  of  the  rules  that  students  are  using  and  permits 
attempts  to  cat^xt  those  rules.  This  is  a  sraiewhat  radical  difference  from  the  traditionally  behavioral 
approach  which  simply  provides  rqpetitious  exercise  on  that  enor  without  considering  the  nile  that  is 
being  used  (see,  for  example.  Brown  &  Burton,  1978). 

In  summary,  a  cognitive  orientation  to  instractional  design  is  based  on  several  assumptions 
(see,  for  example,  Neisser,  1976): 

1 .  The  past  e)q)erience  of  the  learner  is  represented  in  a  highly  intricate  networic  of 
concq)ts  and  relationship  annxig  them.  These  networics,  or  schemata,  direct  other 
behaviors  of  the  learner  such  as  perceptions,  expectations,  strategies,  and  plans. 

2.  The  perceptual  and  motor  processes  select  and  sjojIqis  tiie  learning  environment  for 
information  relevant  to  the  given  learning  goals  and  purposes.  Thus,  the  learner  is 
an  active  processor  of  infonnation. 

3.  The  infomiarion  selected  modifies  tiie  schemata.  In  turn,  the  modification  affects  the 
later  expoiences  through  the  processes  used  and  the  information  to  be  selected. 

As  can  be  seen  this  cycle  en^hasizes  the  activity  of  the  leamer.  Hence,  the  current  emphasis  in 
the  study  of  learning  and  infomiation  processing  on  such  activities  as  orienting  activities,  learning 
strategies,  and  con^rehension  monitoring.  These  emphases  lead  to  some  secondary  assumptions 
(Holley  &  Dansereau,  1984,  p.  xv):  \ 

1.  The  activities  in  which  the  individual  engages  Geamer-based  activities)  in  academic 
or  technical  learning  tasks  affect  the  kinds  of  out.comes  achieved 

2.  The  effectiveness  of  tiie  learner's  activities  can  be  modified  or  enhanced  through 
instruction^  training,  evaluation,  and  remediaticm. 

3.  Instructicmal  strategies  and  activities  (instructor-based  activities)  have  their  effect 
throu^  their  influence  on  the  leamor's  cognitive  activities. 

4.  There  are  currendy  available  learner-based  and  instructor-based  (or  text-based) 
techniques  and  aids  that  can  be  used  as  vehicles  for  enhancing  the  learner's  cognitive 
activities  (Weinstein  &  Mayer,  1985). 

5.  These  activities  can  be  influenced  through  the  use  of  aids  directly  incorporated  into 
the  delivery  of  instruction,  they  can  also  be  influenced  through  instructing  students 
how  to  approach  given  assignments  as  an  integrated  part  of  tiie  curriculum,  or  they 
caii  be  tau^t  to  learners  in  separate  curricula  as  general  procedures. 


A  Comparison  Between  Behaviorally-Based  and  Cognitive-Based  Instructional  Design 

The  purpose  of  instruction,  regardless  of  perspective,  is  to  positively  influence  the  acquisition 
of  certain,  predetermined  learning  outcomes.  It  is  believed  that  the  instructional  msaDS  used  to  obtam 
tiie  instructional  end^  can  have  a  dramatic  effect  on  tiie  qualitative  aspects  of  learning,  such  as  how 
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flexible,  durable,  and  transferable  the  learning  is.  It  is  suggested  that  the  actual  determination  of  the 
instructional  means  is  dq)endent  largely  cxi  which  learning  perspective,  behavorial  or  cognitive,  is 
taken  by  the  instructional  designer.  A  brief  compariscm  of  tiiese  perspectives  will  now  be  addressed 
in  terms  of  each  perspective's  outcome  in  instmctional  design. 

All  designs  assume  that  outconoes  depend  on  an  active  learner.  However,  the  instructional 
designer,  as  co^tivist,  mig^t  differ  fiom  instructional  designer  as  behaviorist  in  hypotheses  about 
how  those  activities  are  engaged  in  learning.  The  instructional  designer  who  takes  an  extime 
bdiavioristic  orientation,  assumes  that  die  delivery  system  and  definition  of  the  task  will  wholly 
detennine  the  learner's  activities  and  should  be  under  conoplete  control  of  the  instructional  medium. 
Note,  for  example,  in  the  earlier  years  of  programmed  learning,  the  instructiond  designer  spoke  of 
''constmcted  respcxises"  to  refer  to  cued-responses  that  had  to  be  supplied    the  learner.  In  addition, 
such  verbs  as  proiq)ting,  fading,  and  the  like  assumed  learning  to  be  under  control  of  die  delivery 
system*  That  particular  orientation  led  to  ignoring  or  neglecting  what  the  learner  was  doing. 

The  cognitivist,  on  the  othor  hand,  mil  assume  furdier  tl^t  the  nature  of  die  activiQ^  is  as 
important  as  mere  activity.  Further  the  cognitivist  assumes  that  die  learner  has  strategies  which  may 
coincide  with  those  expected  by  the  instmctor  but  which  may  also  preempt  those  the  instructor 
presumes  will  be  used  (Not^  diat  the  lole  of  learner  strategies  is  not  considered  within  behavioristic 
orientations).  A  well-meaning  instmctcn:  might  presume  to  set  as  an  objective  the  ''meaningful 
understanding  of  the  subject  matter^'  but  simultaneously  lectures  **£com  the  textbook."  The  instructor 
will  quickly  find  that  students  will  follow  the  textbook  and  underline  those  points  stressed  in  the 
lecture.  Rather  than  develop  diinking  abS&ty  or  understanding,  the  students      fall  far  short  of  the 
goal  of  meaningful  learning  because  the  sti»imts'  own  strategies  en:^hasize  the  selection  of 
information  to  be  learned  in  less  than  meaningful  fashion. 

Finally,  all  instructional  systems  are  based,  intentionally  or  not,  on  the  premise  that  effective 
time-on-task  importandy  influences  learning.  Bodi  the  instructional  designs  and  the  cognitivist 
would  e^ee  that  amount  of  practice  or  amount  of  study  is  related  to  degree  of  learning.  Additionally, 
the  cognitivist  would  be  concemed  with  how  the  nature  of  the  task  would  afifect  the  learner's  activities 
(strategies)  during  the  acquisition  phase  and  how  these  strategies,  in  turn,  would  affect  the  attainment 
of  desired  outcomes. 

By  definition,  all  designs  would  be  based  on  the  assumption  that  the  aforementioned  variables 
operate  interactively.  Thus,  learning  is  direcdy  related  to  the  interaction  of  available  and  accessible 
representations  of  prior  learning,  the  availability  and  use  of  strategies  by  the  learner,  amount  and 
quality  of  the  time  the  learns  is  devotes  to  the  task,  the  deliv^  system,  and  the  nature  of  the 
evaluation. 


Some  possibilities  for  improved  designs,  based  on  current  evidence,  will  be  presented  in  the 
subsequent  sections  of  this  discussion.  The  basis  for  these  recommendations  rests  on  recognizing  the 
role  played  by  cognition,  or  student  thought  processing,  in  learning.  It  is  suggested  that 
improvement  can  only  occur  when  designers  actively  incoiporate  findings  regarding 
information-processing  into  the  instructional  process.  The  essential  idea  is  that  '"research  on  thought 
processes  examines  how  instructional  presentations  infiuence  what  students  think,  believe,  and  feel 
and  how  those  thoughts  in  turn  infiuence  achievement"  (Gark,  1984,  p.2). 

The  following  discussion  presents  some  characteristics  of  instructioial  design  that  are  not 
ordinarily  specified  in  typical  descriptions.  The  points  might  be  considered  as  a  partial  listing  of 
criteria  by  which  a  given  design  might  be  evaluated.  Space  does  not  permit  an  exhaustive  and 
specific  enumeration  of  the  specifics  of  an  'Mdeal"  instructional  design.  Accordingly,  only  a  few 
examples  will  be  provided. 


A  Cognitive  Generation  of  Instmctional  Design 
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Instructional  design  models  often  prescribe  the  writing  of  objectives  by  nieans  of  behavioral 
statements  involving  stimuli,  responses,  and  performance  criteria.  Such  statements  are  useful  for 
training  situaticms  whei:e  p^ormance  critoia  can  be  clearly  specified  Behavioral  objectives  provide 
useful  guides  for  training  settings  since  they  help  the  learner  to  select  relevant  information,  but  left  at 
that  point  bdiavioral  objectives  do  not  meet  the  needs  of  educators  concerned  with  the  acquisition  of 
knowledge  and  thinking  skills. 

Instructional  designers,  including  curriculum  specialists,  often  neglect  the  most  important  of 
objectives:  the  objective  of  achieving  ccxnprehension  and  understanding.  Although  once  an 
ambiguous  construct,  there  is  sufficient  literature  now  existing  that  can  be  useful  in  achieving  a 
definiticm  of  understanding,  comprehension  or  tiiinking.  Understanding  is  an  effective  objective 
since  it  makes  provisions  for  to-be-leamed  material  to  be  assimilated  into  the  knowledge  structure. 
Such  objectives  also  result  in  accommodaticxi  by  a  change  in  the  existing  stmcture  (that  is,  a  new  way 
of  thinking  about  tte  material).  In  the  course  of  such  learning,  procedui^  skills  that  facilitate  transfer 
must  also  be  designated.  (EnxHn  a  cognitive  view,  acquisition  of  facts  is  worthless  unless  there  is 
some  provi^cMi  for  teaching  the  student  how  die  facts  can  be  used). 

Failure  to  attend  to  the  important  objective  of  understanding  can  be  found  in  many  areas  of 
instructicm.  For  exan^le,  scientific  principles  are  often  learned  mechanistically  because  of  the  way 
they  are  taught  There  is  a  growing  body  of  literature  on  ''misconceptions  in  science"  (see,  for 
example,  diSessa,  1982)  stowing  tiiat  even  when  students  are  familiar  with  Newton's  Laws  of 
Motion  they  still  apply  Aristotelian  physics  to  everyday  problems  that  should  be  solved  by  the  use  of 
Newtonian  physics. 

Kinds  of  Knowledge 

Although  instruction  in  declarative  knowledge  (facts,  ideas,  and  so  on)  should  lead  to 
understanding  by  the  learner,  instmction  in  procedural  skills  (whether  part  of  a  perceptual  motor  skill 
or  of  a  cognitive  skill)  should  lead  to  pattern-recognition  and  action-sequences  (operations)  that  may 
or  may  not  use  declarative  knowledge.  Generally,  in  cognate  areas,  procedural  skills  are  interlaced 
with  declarative  knowledge  (as,  for  example,  in  proving  that  two  triangles  are  congruent).  With 
expertise,  procedural  skills  become  automatic,  freeing  cognitive  resources  for  higher-level  processes. 
Acquiring  automaticity,  however,  may  take  tiM>usands  of  trials  (chess  players,  for  example,  take 
thousands  of  hours  of  practice  before  being  capable  of  attaining  ''master"  status).  Instruction  in  bodi 
declarative  and  procedural  knowledge,  even  ttough  well-practiced,  may  become  wel<ted-to-context 
(can  only  be  used  in  limited  settings  such  as  only  to  other  school  subjects)  unless  die  material  is 
presented  in  a  variety  of  settings  and  conditions.  This  provision  for  decontextualization  must  be 
incorporated  into  the  generation  of  cognitive  instructional  designs.  Most  importantiy,  it  seems  that  an 
essential  goal  of  education  is  to  prcxluce  learners  who  can  leam  on  their  own,  to  self-generate  precise 
£q)plications  when  necessary. 

Learning  Strategies 

It  is  apparent  that  the  desired  outcomes  of  instmction,  even  when  carefully  prescribe  and 
delivered,  may  not  always  be  achieved  because  of  the  complex  combinations  and  interaction  of 
influences  that  exist  in  instructional  settings.  What  is  ledmed  depends,  ultimately,  on  how  the 
student  processes  the  information.  Learning  and  processing  strategies  will  be  more  efficient  if  diey 
are  used  to  perform  activities  in  the  same  way  that  learners  process  information,  that  is,  to  the  extent 
that  die  strategy  follows  its  counterparts  in  die  way  die  mental  operations  are  conducted  (Holley  & 
Dansereau,  1984). 

Processing  is  a  complicated  operation.  It  depends  on  the  kind  of  input  or  nature  of  the  task. 
what  the  student  linoMi  what  he/she  does,  amount  of  quality>rime  spent  on  the  task,  and  so  on. 
However,  processing  is  also  dependent  on  die  instructor —  what  the  instmctor  knows  about 
instmctional  methods,  about  the  subject  matter  or  skill  being  taught,  about  die  learner,  and  so  on. 
Even  though  instmctors  know  much  about  these  matters,  there  is  the  influence  of  what  they  actually 
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do.  Even  though  they  know  a  great  deal  about  the  subject,  the  task,  and  instruction,  there  is  no 
assurance  that  Siey  vvili  use  such  knowledge  in  the  same  way  as  another  teacher  or  that  they  will  use  it 
at  all. 

Mayer  (1984)  has  presented  some  examples  of  teacher-based  or  text-based  aids  and  their 
parallels  in  learner-based  strategies.  The  first  level  includes  aids  and  strategies  designed  to  help  select 
relevant  infonnaticm  fix>m  the  instruction.  Examples  of  text-based  aids  at  this  level  include  informing 
the  learner  of  the  behavior  o4)jectives.  The  associated  leamer-based  strategy  might  be  underlining  or 
copying.  At  the  next  level  are  aids  and  strategies  for  organizing  informatjon  within  the  text 
Text-based  aids  here  include  signalling  (e.g.,  '*there  are  three  points  to  be  remembered...",  "in 
summary..."  or  "the  main  idea  is...")-  The  parallel  leamer-based  strategy  might  be  structured 
notetaking,  outlining,  or  concept-mapping.  Organizational  aids  or  strategies  restricted  to  the  text  and 
used  routinely  lead  to  nonmeaningfiil  (verbatim)  learning  and,  thus,  only  slightly  to  transfer. 

Both  selection  and  organizing  are  prerequisites  for  integrating  information  into  the  cognitive 
structure  (integraticxi  being  a  necessary  condition  for  meaningful  learning).  Text-based  aids  include 
advance  CTganizers  or  summaries  placed  at  the  beginning  of  a  chapter.  Leamer-based  strategies 
include  the  making  of  elaborations  or  inferences.  These  extend  the  information  in  the  text  by  adding 
information  that  tlv^  learner  abeady  knows.  The  use  of  ccmtinuity  (making  cause*effect  relations), 
adding  details,  or  using  analogies  and  metaphors  can  be  either  text-based  or  leamo'-based  and  are 
other  means  of  linking  new  infonnation  to  the  cognitive  stracture  of  the  learner.  Material  that  is 
integrated,  and  therel^  made  meaningful,  has  the  advantage  of  not  only  being  retained  and  retrieved 
more  effectively  tfian  partially  mcaningfid  learning  but  is  aJso  more  easily  trcaisfened  to  other  learning 
situations. 

Evaluation 

The  interaction  of  teacher  and  student  knowledge  and  activities  influences  the  learning 
processes,  but  the  outcomes  of  the  process  may  not  be  tapped  or  may  be  misleading  if  inappropriate 
evaluation  measures  are  en[?)loyed.  Whether  teacher-made  or  standardized,  the  tests  used  in  many 
instructional  settings  (outsit  of  training  settings)  often  measure  different  Idnds  of  outcomes  than 
intended.  Such  variation  may  occur  at  different  levels.  For  example,  reading  tests  are  intended  to 
nieasure  compv^ension  of  a  passage  (text*dependent  comprehension),  yet  may  measure  what  the 
reader  knows  rather  than  what  he  or  she  got  out  of  a  passage  (text-independent  tests).  Test  items 
selected  only  on  the  basis  of  Aeir  statistical  characteristics  may  be  found  to  depend  cm  different 
processes  (e.g.,  immediate  recall  of  a  fact  or  idea)  than  those  taught  or  may  measure  different 
outcomes  th^  tfiose  stated  in  the  objectives.  The  designer  must  \yi  concerned  with  whether  items  are 
measuring  factual  information,  conceptual  information,  problem-solving  atnlity,  or  transferability. 
Too  often  soK^alled  achievement  tests  measure  only  the  verbatim  acquisition  of  factual  infonnation 
when  the  desired  outcome  is  die  ability  to  use  that  information  in  a  transfer  situation. 

The  kind  of  test  administered  also  interacts  with  teacher/student  variables.  Teachers  who  do 
not  emphasize  understanding  or  who  may  be  under  a  great  deal  of  extra-school  pressure  (community, 
political,  and  so  on)  may,  for  one  reason  or  another,  resort  to  common  use  of  some  fanil'Jar  form  of 
measurement  such  as  multiple-chdce  tests  that  tend  to  establish  student  expectations  about  how  their 
performance  is  to  be  examined.  These  expectations  influence  the  way  the  material  is  processed; 
students  study  for  multiple-choice  tests  differently  (perhaps  only  for  recognition)  than  they  do  for 
essay  tests  (which  may  require  them  to  study  for  integration  of  information),  for  example. 

Timing  the  Delivery  of  Cjomponent5;  in  Instructional  Design 

In  a  similar  vein,  training  of  teachers  in  instmctional  design,  or  of  any  instructional  procedure, 
does  not  necessarily  provide  assurance  that  they  will  use  that  training.  Similarly,  timing  in  the  use  of 
a  given  component  of  the  design  is  often  neglected  in  instructional  designs.  Timing  of  practice  or 
exercises  may  make  a  difference  in  ease  of  learning.  Thus,  expert  teachers  use  practice  exercises  after 
a  unit  has  been  completed,  whei^  novices  assign  practice  exercises  after  an  "aSrbitrarily"  determined 
time  period,  such  as  the  end  of  a  class  period,  whether  or  not  the  student  has  the  necessary  skills  for 
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conducting  the  exercises  with  competence* 
States  of  Knowledge 

A  fitqucnfly  overlooked  concern  in  instructional  design  is  how  the  infonnation  in  the  relatively 
new  investigations  of  experts  versus  novices  is  to  be  used  There  is  a  vast  amount  of  literature  on 
this  topic  from  a  number  of  sources,  ranging  firom  descriptions  of  the  way  experts  and  novices  play 
chess,  to  what  experts  recall  firom  the  narration  of  a  baseball  game,  ard  to  the  way  experts  and 
novices  conceptualize  physics  problems*  These  studies  imply  that  knowledge  in  the  first  stages  of 
learning  does  not  have  tfie  same  structure  as  knowledge  at  later  stages  of  learning*  Another  premise 
is  that  cognitive  processes  vary  widi  the  stages  of  learning  (for  example,  die  selection  of  supoficial 
features  attended  to  by  novices  and  the  selection  of  fundamentally  more  sophisticated  patterns 
attended  to  by  experts)* 

An  elementary  form  of  a  theory  of  states  of  knowledge  mig^t  be  patterned  after  Rumelhart  and 
Norman's  (1978)  description  of  the  phases  of  learning*  Their  framework  is  interesting  because  it 
concq)tualizes  learning  over  the  long  haul  in  terms  of  three  phases:  accretion,  restructuring,  and 
tuning*  These  phases  correspond  to  early,  middle,  and  later  stages  of  learning  resulting  in  different 
SisiSSL  of  knowledge  at  each* 

Each  state  implies  different  methods  of  teaching,  studying,  and  testing*  In  the  accretion  stage 
new  information  is  delivered  in  a  form  that  links  a  new  idea  witfi  die  student's  knowledge  stmctuie 
and  results  in  the  assimilation  of  that  information*  The  method  of  testing  is  in  the  form  of  typical 
multiple-choice  or  short-answer  tests*  Since  the  knowledge  is  likely  to  be  stored  in  relatively  isolated 
form  there  is  high  probability  of  interference  bom  related  topics*  TransferaWlity  in  this  phase  is  nil* 
In  the  second,  reshucturing,  phase  the  information  already  acquired  is  put  into  different 
organizational  patterns  through  such  means  as  the  inquiry  technique,  the  discovery  method,  or  the 
Socratic  Dialogue*  Interferrace  from  related  topics  is  mediuoL  Transferability  is  high*  Appropriate 
evaluation  measures  here  would  be  the  ability  to  apply  knowledge  to  new  situations  and  the  ability  to 
conceptualize  informatibn*  In  the  final,  tuning,  stage  the  use  of  the  knowledge  (both  declarative  and 
procedural)  is  made  efficient  through  refinement  of  discriminations,  patterns,  and  skills*  Practice 
under  varying  conditions  is  an  important  teaching  device  here  since  new  information  and  skills  are  not 
learned,  onljr  refined*  There  is  low  probability  of  interference  bom  related  information  since  the 
information  is  well-specified  and  contextually  related*  Transfer  of  general  inforaiation  is  high,  but 
transfer  of  specific  iiiformation  is  low  (because  there  has  been  a  well  developed  system  of  patterns)* 
However,  tte  specific  inforaiation  can  be  derived  bom  the  general  information*  The  appropriate 
tests  for  this  level  of  acquisition  would  be  testing  under  stress,  precision  in  the  use  of  a  knowledge  or 
skill,  the  ability  to  use  deep  explanations  of  classifications,  and  the  ability  to  use  die  information  in 
problem  solving* 

One  should  note  that  were  we  to  examine  our  current  instructional  practices  objectively  and 
closely,  we  would  find  that  most  instruction  stops  at  the  accretion  phase*  Although  many,  perhaps 
most,  students  do  ultimately  achieve  higher  states  of  knowledge,  it  is  because  of  the  tendency  of 
human  learners  to  reconstruct  and  otherwise  organize  what  they  have  learned  and  not  because  of  the 
deliberate  attempts  of  their  instructors  or  of  their  textbooks* 

Criteria  for  Effective  Instruction 

Whatever  the  instructional  design  employed  and  whether  the  outcome  is  strategy  or  knowledge, 
the  desired  learning  outcome,  if  achieved,  should  meet  several  priteria,  most  of  which  are  either 
neglected  or  ignored  in  both  typical  instructional  and  research  settings*  These  criteria  include  the 
following: 

1  *  The  achievement  should  be  jQfizdfek-  The  learner  should  be  capable  of  using  the 
knowledge  in  at  least  the  variety  of  settings  in  which  it  will  be  used  frequentiy  * 

2*  The  achievement  should  be  dmahlc-  Learning  the  material  sufficiendy  well  to  "pass" 
an  immediate  test  is  not  acceptable*  Most  information  or  skills  learned  will  not  be 
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used  immediately.  Rather,  they  will  be  used  in  a  subsequent  course,  on  the  job  a 
few  nK)nths  later,  or  even  years  later  when  retraining  may  be  xtquired. 

3.  The  achievement  should  be  transferable,  Theie  are  minimum  requirements  here. 
One,  for  exan^le,  should  be  able  to  use  '"writing  a  checlf '  procedure  for  money 
orders  as  well.  More  demanding  requirements  would  be  required  to  employ  the 
principle  of  refraction  to  solve  problems  involving  lenses,  prisms,  rainbows, 
distortions  in  visual  images  when  a  pencil  is  placed  hdf  way  into  a  glass  of  water,  or 
**mirages"  one  may  see  when  traveling  over  a  hot  desert  road 

4.  The  use  of  strategies  and  knowledge  should  be  self-rcpilated,  Tms  simply  means 
that  they  can  be  used  on  demand  by  the  learner  and  can  be  used  appropriately  for  a 
given  situaticMi  without  the  necessiQr  of  being  cued  by  an  external  source  such  as  an 
Instructor  C*now  use  this  rule  for  solving  the  problem'*). 

Cognitive  Affective  Consideratjoti^ 

The  discussion  above  has  focussed  on  the  acquisition  of  knowledge  and  skills,  sometimes 
described  as  the  ''cold"  side  of  learning.  There  is  underlying  all  of  this,  however,  an 
acknowledgment  of  the  influence  of  the  affective  variables  (see,  for  example,  Lepper,  198S).  Their 
influence  is  most  readily  seen  in  the  concepts  of ''motivation"  and  "feedback".  Due  to  their 
con^)lexiQr,  perhaps,  tiiey  rarely  are  employed  formally  in  instructional  systems  designs.  Rather, 
affective  variables  often  are  merely  cited  as  in^portant  or  described  superficially,  in  descriptions  of 
motivation  and  feedback  as  some  of  the  "events  of  instmcticHi". 

Motivation  includes  botii  affective  and  cognitive  ccnnpcments.  Such  motivations  may  be  in  the 
form  of  motives,  intentions  and  expectations,  attributions,  anxieties,  reward,  avoidance  of  aversive 
stimulation,  informative  feedback,  acceptance  of  a  model's  behavior  in  social  imitation, 
environmental  influences  (such  as  encouragement  in  the  home  for  reading^,  or  attitudes.  There  is  no 
doubt  that  the  affective  ccmiponents  of  learning  need  to  be  incorporated  into  instmctional  design  not 
only  from  tiie  point  of  view  of  the  instructional  designer,  but  from  the  point  of  view  of  tfie  cognitivist 
as  well.  But  the  important  role  of  affective  variables,  as  a  consideration  in  instructional  design,  is 
another  topic  to  be  developed  in  the  future. 

Summai:^ 

This  section  presented  many  examples  of  how  student  thought  processing  ultimately  influences 
achievement  These  views  were  presented  in  contrast  to  the  traditionsdly  behavioral  orientation  which 
systematically  ignores  the  importance  of  cognitive  processing.  The  cognitive  orientation  brings 
student  tiiou^t  processing  to  center  stage.  The  cognitive  orientation  to  instructional  design  is 
summed  up  by  Clark  (1984):  '*llie  distinctive  characteristic  of  cognitive  research  is  the  idea  diat 
instmction  influences  achievement  through  student  thought  processes.  That  is,  instruction  influences 
thinking  and  in  tum  dunking  influences  learning  and  perfcmnance.  The  cognitive  approach  therefore 
assumes  that  instruction  is  mediated  by  student  thought  processes"  (p.  2). 


A  Cognitively  Engineered  Instructional  Design 

In  order  to  serve  as  an  org;anized  conclusion  to  this  discussion,  as  well  as  to  synthesize  the 
thoughts  and  ideas  expressed,  this  last  section  will  present  a  simplified  instructional  design  nuxlel 
which  incorpcnates  a  cognitive  theme.  The  term  "cognitively  engineered  design"  is  used  to  refer  to 
the  instruction/delivery  systenWleamer  interface  which  entails  the  process  of  giving  learners 
experiences  and  training  that  help  them  to  use  and  understand  the  cognitive  sl^ls  most  appropriate  for 
a  given  learning  task  and  to  use  tiie  most  efiRcient  mnsdia  for  accomplishing  the  task.  This  is  a  slight 
dq)arture  froai  its  use  by  Norman  (1980;  1986)  to  refer  to  the  science  of  designing  man-machine 
interfaces,  a  currendy  popular  theme  in  design  problems  raised  by  the  microcomputer  revolution. 
The  term  "cognitively  engineered  instruction"  applies  the  increasing  knowledge  of  human  cognition  to 
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the  advances  in  technology  and  media  as  represented  in  the  model  displayed  in  Figure  L 


Insert  Figure  1  About  Here 


This  model  has  the  three  main  parts  comnx)n  to  all  instructional  design  models: 
pre-instmctional  acdvides;  delivery  (or  administradon)  of  instruction;  and  evaluad(Hi  of  learning 
outcomes  as  integral  parts  of  an  instructional  episode.  A  key  difference  from  traditional  design  is  that 
design  decisions  are  based  on  conceptualizations  of  human  cognition  and  the  learner  as  active  rather 
than  passive.  As  previously  discussed,  a  cognitive  orientation  allows  the  instnicti(mal  designer  to 
make  lesscm  decisions  based  on  how  learning,  understanding  and  memory  occur  rather  than  via  the 
traditional  behavioral  position  of  manipulating  input  without  consideration  of  the  effect  of  internal 
events  on  outc<xnes.  An  advantage  of  a  cognitive  noodel  is  that  it  brings  to  awareness  important 
insights  inK>  situations  where  learning  does  not  occur  as  planned  and  provides  means  of  revising  the 
design.  Both  behavioral  and  costive  positions  provide  ''ammunition*'  in  the  struggle  to  help 
facilitate  learning,  but  the  cognitive  approach  provides  more  informaticm  about  'Vhere  to  aim". 

Initially,  two  activities  must  tate  place  befoir.  the  instraction  can  be  delivered  The  learner's 
cognitive  state  needs  to  be  idmtified  while  the  learning  outcomes  of  the  instructional  task  are  defined. 
Fbr  example,  if  the  instractional  task  is  to  consider  what  events  led  the  Ncxth  to  victory  in  the  QvU 
War,  then  a  great  many  facts  need  to  be  considered  quickly  and  efficiendy.  A  student  who  is  at  the 
accretion  stage  (and  thus  is  just  beginning  to  acquire  the  necessary  facts  about  the  Civil  War)  would 
obviously  be  unable  to  handle  the  problem  solving  task  presented*  Hence,  the  states  of  die  learner 
and  of  the  instruction  are  incompatible  and  mismatched  It  would  be  firuidess  to  require  the  learner  to 
proceed  widi  die  task  and  continuing  to  do  so  would  only  lead  to  frustration  for  bodi  learner  and 
teacher.  By  die  same  tdken,  a  learner  at  die  nining  stage  has  all  of  die  important  facts  and  concepts 
about  die  Civil  War  selected  and  organized.  Activities  which  continue  to  review  the  same  facts  would 
prove  very  tedious  and  boring.  Such  learners  require  experiences  which  foster  accessing  and 
applying  diat  learned  information  in  new  and  creative  ways.  For  efficient  and  effective  learning  to 
occur,  the  learner's  cognitive  state  and  die  learning  outcome  of  the  instruction  desired  should  match. 

Once  die  learner's  cognitive  state  and  the  learning  outcome  are  perceived  as  compatible,  die 
designers  must  ensure  diat  die  activities  and  learning  experiences  presented  foster  die  desired 
outcome.  This  second  stage  in  planning  die  delivery  of  instmction  requires  diat  cognitive  processes 
corresponding  to  die  state  of  die  learner's  knowledge  (e.g.,  accretion,  restructuring,  or  toning)  are 
activated  Fbr  example,  typical  teaching  techniques  such  as  the  use  of  mnemonic  aids  and  rehearsal 
strategies  might  work  well  for  die  accretion  stage  where  the  learner 's  in  die  process  of  selecting 
relevant  information     acquisition  and  stxmge  preparatory  to  organizing  it  But  diese  same 
activities  are  relatively  poor  for  higher  order  processing  that  wodd  be  required  as  die  learner  further 
organizes,  integrates,  and  chunks  infmnation  into  useful  schematic  knowledge  representations. 
Instead,  learning  activities  might  include  analogical  reasoning,  mctaphoric  representations, 
elaboraticm,  summarization,  identifying  cause-effect  relations,  or  S|^tial  mapping.  A  learner  at  die 
toning  stage  would  benefit  from  acdvides  diat  would  fosier  additional  elaboration  of  die  lesson 
matenal,  ability  to  make  applications  to  a  variety  of  everyday  situations  or  to  achieve  automaticity  in 
pattern  recognition,  die  use  of  procedural  knowledge,  retrievatnUQ^  and  so  on.  Different  instructional 
activities  foster  (activate)  different  cognitive  processes.  Appropriate  cognitive  processing  needs 
instructional  activities  geared  to  achieve  die  use  of  specific  processes. 

Even  widi  diese  precautions,  standardized  learning  outcomes  for  all  snidents  can  never  be 
guaranteed  due  to  the  many  factws  which  enter  and  complicate  die  instructional  setting.  Proper 
evaluation  of  die  type  of  learning  expected  can  be  very  difficult  especially  when  diis  learning  is 
beyond  die  accretion  stage.  It  would  probably  be  radier  difficult  (though  not  impossible)  for  an 
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instructional  designa  to  constnict  multiple-choice  questions  which  test  students  at  the  restructuring  or 
tuning  stage.  A  variety  of  testing  situations  would  be  necessaiy  to  derive  an  accurate  picture  of  these 
types  of  learning.  An  example  of  sudi  a  testing  technique  would  be  to  give  the  student  a  stoiy 
without  an  ending  and  ask  for  plausible  predictions.  As  in  most  instructional  design  models,  if  the 
designated  criterial  level  has  not  been  attained  a  decision  must  be  made  whether  to  provide  the  learner 
with  remedial  activities  such  as  different  strate^es  or  techniques  for  coo^hension  monitt>ring  or 
whether  some  revision  of  the  instructional  level  of  the  curriculum  is  necessary  to  adapt  to  the  learners 
cognitive  state  or  level  of  knowledge  representation  and  then  have  the  leamer  recycle  through  a 
portion  of  the  pro|;ram.  The  remediation  box  displayed  in  Figure  1  requires  tfie  same  considerations 
regarding  processmg  demands  as  any  other  part  of  the  design. 

Lastly,  it  must  be  remembered  diat  tfus  model  has  been  greatly  oversiaq)lified  to  make  the 
dialogue  readable.  For  exan^le,  it  is  widely  recognized  that  the  three  cognitive  stages  discussed 
(accretion,  restnicniring,  tuning)  are  not  mutually  exclusive.  A  leamer  is  almost  certainly  interacting 
with  the  instructional  material  at  all  levels  to  some  extent  The  intention  of  painting  this  "cognitive 
picture*'  of  the  instructional  design  process  has  been  to  set  the  stage  for  understanding  the  advantages 
of  considering  instructional  design  fiom  a  cognitive  orientation.  Future  developments  in  instructional 
design  should  reflect  this  cognitive  view. 
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PROGRAMMING  FOR  EFFECTIVE  CONCEPT  LEARNING: 
VHERE  SHOULD  THE  BRANCHES  GO  AND  WHY? 

Marcy  P.  Driscoll,  John  V.Dempsey, 
a'^d  Brenda  S.  Litchfield 
The  Florida  State  University 


One  of  the  strengths  often  cited  for  computer-based 
instruction  is  its  capacity  for  providing  adaptive  learning 
experiences  to  students.    These  experiences  may  be  adaptive  in 
the  sense  that  they  provide  differential  instructional  sequences 
to  learners.    Or  they  may  be  adaptive  in  the  type  of  feedback 
they  present  in  response  to  various  answers  given  by  learners. 
Both  types  of  adaptation  present  questions  to  instructional 
designers  as  to  which  instructional  sequences  or  what  types  of 
feedback  will  most  effectively  iEacilitate  the  desired  learning. 

In  two  s^  idies  to  be  reported  in  this  paper,  we  investigate 
the  effects  ox  adaptive  sequencing  of  examples  and  adaptive 
feedback  on  concept  learning  via  computer-based  instruction. 
According  to  Tennyson  &  Cocchiarella  (1986)/  concepts  are  best 
learned  when  interrogatory  examples  of  the  concepts  are 
systematically  presented  to  develop  both  discrimination  and 
generalization  abilities  in  the  learners.    Thus,  they  recommend 
that  1)  examples  be  presented  in  an  easy  to  difficult  sequence, 
2)  examples  and  nonexamples  be  presented  within  a  specific 
context  or  problem  domain  (to  enhance  discrimination),  and  3) 
examples  be  presented  in  a  number  of  contexts  (to  enhance 
generalization).    Finally^  attribute  feedback  is  recommended  when 
it  appears  to  be  necessary. 

In  order  to  i  nable  the  systematic  creation  of  examples  that 
embody  the  racommendations  listed  above,  Driscoll  &  Tessmer 
(1985)  developed  a  technique  they  called  the  rational  set 
generator  (RSG) .    Examples  generated  using  the  RSG  range  in 
difficulty  from  easy  to  discriminate  or  generalize  to  difficult 
to  both  discriminate  and  generalize  (see  Figure  1).  Empirical 
results  have  thus  far  confirmed  the  effectiveness  of  the  RSG  for 
designing  concept  examples  for  use  in  print  instruction  (e.g., 
Tessmer  &  Driscoll,  in  press). 

Since  the  RSG  is,  in  essence,  a  "shell"  for  creating 
examples  that  vary  from  one  another  in  systematic  ways,  it  also 
holds  promise  as  a  framework  for  sequencing  interrogatory 
examples  in  computer-based  instruction <>    For  example,  students 
may  be  presented  all  of  level  1  (easiest)  examples,  followed  by 
all  of  level  2  (harder)  examples,  and  so  on.    Or  the  sequence  may 
be  adapted  on  the  basis  of  the  individual  student ^s  pattern  of 
responser.    That  is,  a  student  making  a  classification  error  on  a 
level  2  example  may  encounter  a  level  1  example  next,  while 
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someone  answering  the  level  2  example  correctly  may  go  on  to  a 
level  3  example.    Because  the  examples  are  theoretically  related 
in  a  particular  way,  different  patterns  of  achievement  can  be 
predicted  by  different  instructional  sequences. 

Learning  may  also  be  affected  by  the  type  of  feedback 
students  receive  when  they  classify  examples  incorrectly.  Some 
sort  of  corrective  feedback  is  generally  recommended  (Kulhavy, 
1977),  and  Alessi  &  Trollop  (1985)  recommend  increasingly 
informative  feedback  after  each  successive  wrong  answer,  although 
they  admit  that  empirical  support  for  this  recommendation  is 
unclear.    Since  feedback  on  concept  attributes  may  be  important 
to  correct  classification  errors,  and  it  was  unclear  how  this 
might  best  be  provided,  this  offered  a  second  variable  o£ 
interest  related  to  the  RSG. 

Dempsey  (1986)  designed  a  template  for  programming  the  RSG, 
and  Driscoll  &  Dempsey  (1987)  implemented  this  template  with 
microcomputers  and  conducted  a  validation  study  with  concept 
instruction  in  educational  psychology.    To  build  on  those  results 
and  begin  to  investigate  the  questions  of  interest  discussed 
above,  the  current  studies  were  undertaken.  « 


Study  1 

The  primary  question  investigated  in  the  first  study  was: 
Will  an  adaptive  sequence  of  interrogatory  examples  that  provides 
specific  discrimination  training  be  more  effective  for  teaching 
concepts  than  a  simple  adaptive  sequence?    Siegel  &  Misselt 
(1984)  taught  foreign  language  word  associations  using  a  drill 
and  practice  CAI  program  and  found  that  students  made  fewer 
errors  when  they  were  provided  with  adaptive  feedback  combined 
vlth  discrimination  training  than  when  they  received  adaptive 
feedback  alone. 

In  the  present  study,  a  set  of  five  behavior  management 
concepts  (e.g.,  positive  reinforcement,  extinction,  etc.)  were 
taught  using,  on  IBM  microcomputers,  the  RSG  framework  for 
presenting  interrogatory  examples.    Forty-six  undergraduate 
students  randomly  assigned  to  the  simple  adaptive  condition 
progressed  to  more  difficult  examples  when  they  gave  a  correct 
response,  but  were  branched  to  a  lower  level  (easier)  example 
when  they  made  an  error.    Forty-one  students  in  the 
discrimination  training  condition  progressed  in  the  same  way  to 
more  difficult  examples  when  they  responded  correctly.  However, 
upon  making  an  error,  these  students  would  be  branched  to  new 
examples,  presented  simultaneously,  of  both  the  concept  that  was 
missed  and  the  one  with  which  it  was  confused.    Then  they,  too, 
would  next  see  an  easier  example  than  the  one  on  which  they 
erred.    Feedback  presented  for  correct  and  wrong  answers  was  the 
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same  for  both  groups.      Both  groups  were  also  required  to 
correctly  answer  the  most  difficult  example  of  each  concept 
before  they  could  exit  the  instructional  RSG. 

Achievement  was  examined  using  a  15-ltem  posttest  assessing 
classification  of  new  examples  of  the  five  concepts.  The 
examples  that  comprised  this  test  were  established  by  a  previous 
study  to  parallel  the  difficulty  levels  of  the  examples  in  the 
practice  RSG.    This  test  wa^  administered  via  the  microcomputer 
immediately  after  the  student  had  successfully  completed  the 
instructional  RSG.    Instructional  time  and  the  average  number  of 
examples  seen  by  students  in  each  group  were  also  recorded. 

It  was  expected  that  students  in  the  discrimination  training 
condition  would  perform  better  than  those  in  the  simple, adaptive 
condition,  since  they  would  have  received  instruction  designed 
specifically  to  correct  a  discrimination  confusion.    Time  and 
number  of  examples  attempted  by  students  Were  examined  because 
those  in  the  discrimination  training  group  might,  by  virtue  of 
the  extra  instruction  it  contained,  encounter  more  examples  and 
spend  more  time  than  students  in  the  other  group.    If  this  were 
to  occur,  a  question  of  instructional  efficiency  vs.  performance 
might  ensue. 

Results.    Contrary  to  prediction,  there  were  no  significant 
differences  in  either  instructional  (on  the  practice  RSG)  or  ^ 
posttest  performance  between  the  two  groups.    On  the  posttest,' 
students  in  the  simple  adaptive  condition  scored,  on  the  average, 
91.9  percent  correct  (standard  deviation^  10.1)  while  those  in 
the  discrimination  training  group  scored,  on  the  average,  92*1 
percent  correct  (s.d.  =  9.6).    Performance  did  improve,  however, 
from  instruction  to  the  posttest,  with  students  overall  correctly 
answering,  on  the  average,  78.2  percent  of  the  instructional 
items  and  92*1  percent  of  the  posttest  items.    This  improvement 
was  significant  (T  =  11.29,  df  ?  86,  p  <  .01). 

No  significant  differences  appeared  between  groups  on 
instructional  or  testing  time,  although  students  in  the 
discriminatiori'  training  group  took  an  average  of  2  seconds  longer 
per  question  than  the  other  group.    Since  this  group  made  an 
average  of  2  1/2  %  more  errors  on  the  first  attempt  than  the 
simple  adaptive  group,  it  Is  likely  that  the  additional  time  they 
took  came  from  answering  a  few  more  questions. 

Discussion.    Prom  our  perspective,  it  seemed  that  the 
results  observed  in  this  study  represented  a  ceiling  effect 
occurring  in  student  performance.    On  the  average,  students 
missed  only  one  question  on  the  posttest.    With  such  high  scores 
to  begin  with,  there  was  no  room  for  improvement  that  could  be 
attributed  to  the  instructional  manipulation*    What  the  results 
perhaps  do  tell  us  is  that  the  basic  RSG  instruction  did  its  job 
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well,  and  well  enough  with  that  particular  set  of  concepts  and 
class  of  students  to  require  no  additional  Instructional, 
conditions* 

Study  2 

In  Study  2,  our  purposes  were  to  extend  the  application  of 
the  RSG  framework  and  Investigate  the  effects  of  different  types 
of  wrong  answer  feedback  on  concept  and  rule  learning.    In  this 
study,  we  developed  and  formatively  evaluated  4  successive  RSGs — 
one  set  of  concrete  concepts,  two  sets  of  defined  concepts,  and 
one  set  of  rules — for  a  lesson  on  drugs.    The  RSG  template  was 
programmed  for  PLATO  and  the  lesson  was  Implemented  as  part  of  a 
general  biology  lab  taken  by  mostly  freshman  college  students. 

The  question  of  appropriate  and  effective  feedback  for  CAI 
lessons  Is  one  that  has  not  yet  been  fully  answered.    Wager  & 
Wager  (1985)  assert  that  more  effort  has  gons  toward  developing 
formatting  guidelines  than  to  synthesizing  learning  research  for 
guidance  In  determining  effective  feedback.    Of  particular 
importance,  perhaps,  is  whar  learners  do  with  the  feedback  that 
is  provided.    Suppes  &  Ginsberg  (1962)  suggested  that  students 
should  be  required  to  type  in  a  correct  answer  after  an  error  has 
been  made  and  feedback  provided,  and  this  is  a  strategy  routinely 
programmed  into  some  CAI  lessons.    However,  Slegel  &  Mlsselt 
(1984)  offer  the  opinion  that  such  a  strategy  is  unlikely  to  be 
facultative  of  learning  unless  the  student  is  in  some  way  forced 
to  make  the  connection  between  the  correct  answer  and  the 
question. 

In  the  present  study,  we  argued  that  the  type  of  desired 
learning  outcome  should  dictate  the  feedback  provided  in  the 
lesson.    Moreover,  both  depth  of  processing  studies  and  studies  * 
of  elaboration  techniques  suggest  that  students  who,  in  some  way, 
more  deeply  process  or  elaborate  the  correct  answer  following  an 
error  should  show  superior  performance  to  those  who  do  notr  . 

Therefore,  we  developed  four  levels  of  feedback  to  follow  an 
incorrect  response.    The  lowest  level  was  declarative  in  nature 
and  required  no  additional  response  from  the  sf;udent  (e.g*,  **No, 

the  correct  answer  is   .    Press  return  to  continue.").  The 

second  level  involved  an  elaboration  of  the  correct  answer,  but 
still  required  no  additional  response  from  the  student  (e.g., 

"No,  the  correct  answer  is  .    The  reason  this  is  correct  is 

 . ").    The  third  level  required  students  to  repeat  the  correct 

answer  after  it  was  given;  how  this  action  was  performed  depended 
on  the  nature  of  the  outcome  [e.g.,  "Type  the  (name)  af  the 
correct  answer"  (identity  items)  vs.  "Type  the  letter  of  the 
correct  answer"  (classification  questions)].    Finally,  the  fourth 
level  required  some  additional  processing  to  be  done 
by  the  student.    This  was  accomplished  by  the  presentation  of  a 
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simple  multiple  choice  question  following  the  correct  answer  that 
required  an  answer  before  the  student  could  continue.  These 
questions,  too,  depended  on  the  type  of  learning  outcome  (e.g«, 
for  a  defined  concept,  '!The  correct  answer  should  include 
attributes  A,  B,  and  C.    Which  of  the  examples  below  contains  all 
of  these  attributes?"). 

A  "No  Treatment"  control  group  was  also  included  in  this 
study  to  ascertain  whether  the  instruction  itself  actually  had 
the  desired  effect.    This  group  did  not  participate  in  the 
instruction,  but  did  take  the  posttest  at  the  same  time  it  was 
administered  to  the  experimental  groups. 

While  the  course  from  which  students  were  selected  for 
participation  in  this  study  is  typically  large,  on  the  order  of 
1100  students  per  semester,  students  were  not  randomly  selected. 
Rather,  the  coordinator  of  the  course,  which  is  a  laboratory 
course,  identified  3  lab  instructors  she  believed  would  be  the 
most  cooperative  and  perhaps  interested  in  what  we  hoped  to  do. 
Then,  for  each  lab  instructor,  three  lab  sections  of  20  or  22 
students  each  were  randomly  selected,  two  to  be  designated 
"experimental"  and  the  third  to  be  designated  "control."  Thus, 
we  hoped  to  control  as  much  as  possible  for  a  potential  "teacher 
effect." 

Since  we  were  not  perniitted  to  require  participation  in  the 
experimental  groups,  we  offered  the  inducement  of  "extra  points" 
that  students  could  apply  toward  their  overall  grade  in  the 
course.    Of  120  possible  experimental  subjects,  therefore,  55 
students  actually  participated,  spread  randomly  and  approximately 
equally  across  the  four  experimental  groups. 

Students  completed  the  PLATO-delivered  instructional  RSG 
outside  of  their  regular  laboratory  class  times,  but  took  an  18- 
item  objectives-referenced  posttest  as  a  part  of  a  regularly 
scheduled  class  quiz.    This  paper-based  posttest  was  developed 
and  evaluated  by  the  experimentors,  and  given  to  the  lab 
instructors  to  administer. 

It  was  expected  that  all  experimental  students  would  perform 
better  as  a  group  than  the  control  students.    Within  the 
experimental  group,  it  was  anticipated  that  groups  receiving  ' 
elaborated  feedback  or  feedback  that  required  a  response  would 
perform  better  than  the  group  receiving  only  the  correct  answer 
feedback.    In  addition,  of  the  two  groups  required  to  make  a 
response,  those  students  forced  to  process  the  feedback  were 
expected  to  outperform  those  who  merely  repeated  the  correct 
answer. 


Results.    As  expected,  students  who  undertook  the  PLATO  RSG 
instruction  performed  better  on  the  posttest  than  those  who  did 


not  (80.0%  to  56»5%  ;  T  =  7.23,  df  =  96,  p  <  •01) •    However,  no 
significaat  differences  in  performance  were  observed  among  the 
four  experimental  groups.    The  posttest  means  and  standard 
deviations  for  all  groups  are  displayed  in  Table  1* 


TABLE  1:  Average  posttest  performance  in  terms  of  percent 
correct  for  four  experimental  and  a  no-treatment 
control  group 


Experimental  Treatment  Groups 

Mean 

?.D. 

CA  only 

78.6 

18.8 

Elaborated  (CA  -f 

81.2 

15.5 

explanation  of  CA) 

Forced  repetition  (CA  + 

84.8 

9.3 

"type  CA  to  continue") 

Forced  processing  (CA  + 

76.7 

16.4 

No  Treatment  Control  Group 

56.5 

16.6 

An  analysis  of  covariance,  with  the  course  final  exam  score 
serving  as  the  covariate,  was  conducted  on  posttest  scores  for 
the  experimental  groups.    While  the  final  exam  score  explained 
approximately  15%  of  the  variance  [F  (1,52)  -  9.25,  p  <  «05],  the 
main  effect  for  group  explained  only  2%  IF  (3,52)  »  «44,  ns]«  In 
view  of  these  overall  results,  no  additional  planned  comparisons 
were  undertaken.    We  also  observed  that  students*  scores  under 
one  of  the  three  teachers  were  consistently  lower  than  other 
students,  but  this  effect  did  not  appear  to  interact  with 
expected  effect  of  type  of  feedback  on  performance* 

Discussion*    The  results  of  this  study  offer  little  in  the 
way  of  definitive  answers  to  the  question  of  what  is  appropriate 
and  effective  feedback  for  CAI  lessons  teaching  concepts  and 
rules*    In  effect,  it  demonstrated  only  that  adaptive  practice 
with  some  sort  of  feedback  is  better  than  none  at  all,  or  at 
least  that  which  students  will  do  on  their  own  left  to  their  own 
devices.    Perhaps  we  may  also  conclude  that  feedback  specifically 
designed  according  to  the  type  of  learning  outcome  is  effective* 

It  is  interesting,  however,  that  students  forced  to  answer 
an  additional  question  after  they  made  a  wrong  response  performed 
less  well  than  all  other  groups.    We  can  only  speculate  at  this 
point  that  they  may  not  have  followed  directions  in  this 
condition  as  much  as  we  expected*    That  is,  we  observed  in  this 
class  of  students  a  general  distaste  for  reading*    Since  the 
forced  processing  condition  required  much  more  reading  than  any 
of  the  other  conditions,  students  may  have  pressed  any  answer  to 
continue  rather  than  taking  the  time  to  read  and  answer  the 
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additional  question* 


General  Discussion 

Taking  these  two  studies  together,  what  can  be  conduced? 
Unfortunately,  less  than  we  had  hoped*    In  both  studies,  the  RSG 
framework,  shown  previously  to  be  useful  in  print  instruction, 
appeared  to  be  equally  effective  for  use  in  computer-based 
instruction.    Students  learned  from  their  practice  on  the 
instructional  RSGs,  and  produced,  as  a  consequence,  very 
acceptable  performances  on  posttests  covering  the  same  material. 

Given  that  neither  experimental  manipulation  conducted  in 
these  studies  produced  statistically  significant  effects,  we  are 
left  with  questions.  Will  type  of  adaptive  sequence,  or  type  of 
feedback,  have  the  predicted  effect  on  performance  under  other 
conditions?  Of  so,  what  are  they?  Or,  does  the  RSG  framework 
have  strong  enough  effects  itself  on  performance  to  mask  other 
potential  effects? 

We  anticipate  that  planned  future  investigations  and 
replications  may  help  to  answer  these  questions  and  may  shed  some 
light  on  the  original  problem  with  which  we  began  this  research: 
Where  should  we  put  the  branches  in  CAI  lessons  to  facilitate 
concept  learning,  and  why? 
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Model  Matrix  of  a  Computerized 
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Abstract 


This  study  examined  the  relationship  of  cogivitive  style  and  ability 
to  the  initial  acquisition  of  computer  programming  competence.  The 
selected  cognitive  style  (field- independence)  and  three  cognitive 
abilities  (Logical  reasoning,  spatial,  and  direction  following)  were 
correlated  to  five  programming  component  skills.    The  five  prograrjsing 
component  skills  measured  in  this  study  included;  (1)  knowledge  of  BASIC 
syntax.  (2)  ability  to  predict  program  outcc^^s.  (3)  ability  to  design 
and  write  programs.  (4)  ability  to  debug,  and  (5)  ability  to  modify 
programs  in  BASIC.    Forty-six  college  students  i\i  a  computer  liter^icy 
course  participated  in  this  study.    Re*;*      •  indicated  that  field- 
independence,  logical  reasoning  and  dix      ^,on  following  were  strongly 
relate  to  most  programming  i^kills.    Spatxal  ability  was  related  to  only 
debugging  and  modification. 
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Cognitive  Style,  Cognitive  Ability,  and  the  Acquisition  of 
Initial  Computer  Progranuning  Competence 

The  curriculum  of  computer  literacy  has  been  controversial  since 
first  introduced  as  a  course  of  study,  and  remains  an  unresolved  issue. 
Computer  literacy  curricula  have  included  one  or  a  combination  of 
following  content;  computer  programming,  computer  applications,  and  use 
of  hardware  and  software.    In  recent  years,  the  focus  of  curriculum  has 
shifted  from  programming  language  learning  to  computer  application. 
However,  proponents  for  teaching  programming  in  schools  argue  that 
computer  technology  is  a  multi-purpose  technology.    Therefore,  the 
powerful  ideas  that  underlie  programming  enable  students  to  communicate 
and  interact  with  a  myriad  of  other  computer  applications  (Soloway, 
1987) »    Most  teachers  who  include  computer  programming  in  computer 
literacy  argue  that  programing  provides  a  hands-on  computer  experience  in 
an  environment  where  students  are  in  control  (Luehrmann,  1981) . 
Programming  has  become  an  integral  part  of   many  computer  literacy 
curricula. 

Programming  is  complex  and  novice  programmers  bring  a  variety  of 
cognitive  skills  and  styles  to  the  challenge  of  programming.  Individual 
differences  that  exist  prior  to  learning  new  skills  are  important 
instructional  conditions  for  planning  instructional  treatments.  However, 
the  relationship  between  competence  in  computer  programming  and  cognitive 
characteristics  in  learners  has  not  been  well  researched  (Linn,  1985). 

Ob  "I  active 

The  objective  of  this  paper  is  to  describe  the  relationship  between 
one  cognitive  style  and  five  programming  component  skills,  plus,  the 
relationship  between  three  cognitive  abilities  and  five  programming 
component  skills.    Th^  single  cognitive  style  selected  for  this  study  was 
field  independence.    The  three  cognitive  ability  factors  were  logical 
reasoning  ability,  spatial  ability,  and  direction  following.    The  five 
components  of  computer  programming  success  were:  syntax,  program 
comprehension,  program  composition,  debugging  and  program  modification. 

Background 

Considerable  research  has  been  conducted  to  identify  factors  that 
are  associated  with  programming  outcomes.    Findings  suggest  that  there  is 
a  positive  relationship  between  programming  outcomes  and  cognitive 
variables  (i.e.,  general  intelligence,  mathematical  ability,  academic 
achievement).    Therefore,  it  is  plausible  to  hypothesize  that  individual 
difference  in  the  initial  acquisition  of  programming  competence  may  be 
related  to    cognitive  style  and  cognitive  ability. 
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Cogntttve  Style 

Cognitive  style  refers  to  the  manner  in  which  individuals  process 
information;  how  they  think  (Witkin,  Moore,  Goodenough,  &  Cox,  1977). 
According  to  cognitive  style  theory  (Ausbum  &  Ausbum,  1979;  Messick, 
1984;  Kolb,  1984),  individuals  develop  a  preferred  way  of  thinking, 
problem- solving,  and  interacting  with  the  environment.    A  commonly 
identified  cognitive  style  in  relation  to  academic  achievement  is  the 
fie Id- independent/fie Id  -dependent  continuum.    This  style  is  identified 
by  the  Embedded  Figiires  Test  (EFT)  or  Group  Embedded  Figures  Test  (GEFT) 
which  measures  subject  performance  on  a  series  of  problems  in  which  the 
subject  must  find  a  simple  figure  in  the  context  of  a  complex  set  of 
figures » 

Field- independent  learners  tend  to  impose  structure  on  a  field  if  a 
logical  pattern  does  not  exist,  whereas  field- dependent  learners  accept 
the  field  the  way  it  is  (Witkin,  Moore,  Goodenough,  &  Cox, 1977).  In 
addition,  field- independent  learners  appear  to  have  greater  skill  in 
"cognitive  restructuring";  that  is,  in  understanding  problems  and 
reformulating  problems  into  structured  ideas.    Skill  in  cognitive 
restructuring  has  been  found  to  be  related  to  success  in  mathemr-tics  and 
in  the  physical  sciences  (Witkin,  Moore,  Goodenough,  &  Cox,  1977), 
Computer  programming  seems  to  demand  cognitive  skills  which  have  been 
developed  by  field- independent  learners.    Programmers  ofter  have  to 
reformulate  problems  into  structured  ideas  and  detect  irregularities  in 
programming  logic.    Similarities  between  cognitive  skills  used  by  field- 
independent  learners  to  solve  novel  problems,  and  cognitive  requirements 
for  computer  programming  has  led  several  researchers  to  hypothesize  a 
relationship.    Many  have  fotind  a  moderate  but  positive  relationship 
between  field- independence  and  computer  programming  success  (Stevens 
1983;  Webb,  1985;  Bradley,  1986). 

Cognitive  Ability 

Snow  (1980)  suggests  that  cognitive  ability  can  be  further 
subdivided  into  two  categories  based  on  cognitive  functions.  Crystall- 
ized ability  (general  ability)  is  an  ability  to  apply  accumulated 
learning  skills  to  the  acquisition  of  new  skills  (general  intelligence, 
mathematical  ability),    whereas  fluid  cognitive  ability  (specific 
ability)  is  a  skill  that  is  needed  to  modify  performance  requirements 
(i.e,  spatial,  reasoning,  following  directions).    Snow  (1980)  also 
suggests  that  when  a  learning  task  is  novel  to  the  learner,  fluid  ability 
is  more  relevant  than  p;  ^viously  crystallized  learning  skills. 

Since  learning  to  program  is  a  new  experience  for  most  students 
seeking  computer  literacy,  fluid  ability  may  be  more  closely  related  to 
computer  programming  success.    In  addition,  numerous  studies  have 
correlated  programming  success  and  crystallized  ability  (i.e,  mathe- 
matical, verbal,  academic  achievements  in  mathematic  or  science) 
suggesting  that  mathematical  and  academic  achievement  is  a  strong 
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predictor  of  programming  success  (Peterson  &  Howe,  1979;  Mazlack,  1980; 
Konvalina,  Wileman,  &  Stephens,  1983;  Fisher,  &  Mandinach,  1985;  Webb, 
1985;  Mayer,  Dyck,  Vilberg,  1986;  McCoy  &  Burton,  1987). 

General  ability  is  often  a  combination  of  many  specific  cognitive 
abilities.     Most  computer  programming  aptitude  tests  measure  general 
ability,  and  show  a  moderate  correlation  between  test  scores  and 
programming  performance  (i.e,  IBM  Programmers  Aptitude  Test,  Aptitude 
Assessment  Battery- Programming) .    However,  these  findings  are  of  little 
value  in  developing  an  instructional  treatment  to  meet  the  differing 
needs  of  individual  students.    As  Webb  (1985)  points  out  "...since 
programming  aptitude  tests  typically  assess  a  combination  of  abilities, 
it  is  difficult  to  determine  ^Aether  some  abilities  are  more  important 
than  others  for  predicting  performance"  (p. 184). 

ProgrflimntTIg  ^pd  Individual  differences 

Programming  is  made  up  of  component  skills  (Shneiderman,  1980;  Pea  & 
Kurland,  1983)  and  each  skill  may  favor  a  different  cognitive  ability  or 
cognitive  style.    Several  studies  have  explored  the  relationship  among 
cognitive  style,  cognitive  ability  and  computer  programming  performance 
in  children  and  precollege  students  (Fletcher,  1984;  Webb,  1984,  1985; 
Bradley,  1986;  Pommersheim,  1986;  McCoy  &  Biirton,  1987).    However,  only  a 
few  studies  (Snow,  1980;  Mayer,  Dyck,  Vilberg,  1986;  Werth,  1986)  have 
examined  the  relationship  of  cognitive  style  and  ability  in  adults.  Snow 
(1980)  correlated  diverse  individual  characteristics  with  programming 
outcomes.    He  found  that  only  two  of  the  many  individual  characteristics 
were  significantly  related  to  learning  BASIC  at  college  level.  He 
concluded  that  fluid  analytical  ability  was  more  important  than  general 
crystallized  ability  in  predicting  a  learning  outcome. 

Mayer,  Dyck,  &  Vilberg  also  found  logical  reasoning  and  spatial 
ability  to  be  significant  factors  in  learning  BASIC.    However,  they 
suggested  that  specific  cognitive  skills  such  as  direction  following, 
word  problem  translation,  and  procedure  following  were  better  predictors 
of  learning  BASIC.    Werth  (1986)  found  that  field- independence  was 
significantly  related  to  course  grade  in  an  introductory  PASCAL  course. 
Since  computer  programming  requires  a  combination  of  many  skills, 
examining  the  relationship  between  a  specific  cognitive  factor  and 
several  programming  component  skills  may  impact  upon  programming 
instruction.    However,  only  a  few  studies  have  examined  specific 
cognitive  predictors  in  regard  to  programming  component  skills.  Webb 
(1984,  1985)  found  that  spatial  ability  was  the  best  predictor  for 
knowledge  of  LOGO  and  BASIC  commands,  and  that  field- independence  was 
moderately  related  to  programming  skills  in  LOGO,  but  not  in  BASIC. 
These  findings  provide  insight  into  the  cognitive  requirement  for  novice 
programming,  but  more  research  is  needed  to  better  understand  the 
relationship  between  individual  differences  and  programming  outcomes. 
The  selected  cognitive  factors  also  need  further  investigation  in  order 
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to  apply  general  findings  to  adult  novice  progranmers ,  since  it  is  not 
certain  that  the  cognitive  skills  of  young  children  and  the  cognitive 
skills  of  adults  predict  the  same  outcomes  in  learning  computer 
programming. 

Method 

Subjects 

Forty-six  students  who  enrolled  in  a  computer  literacy  course  during 
the  fall  term  of  1987  participated  in  this  study,  to  include,  seventeen 
graduate  students  and  twenty-nine  jtmiors  and  seniors  in  the  school  of 
education.    Their  ages  ranged  from  21  to  46,    Sixteen  students  reported 
that  they  had  used  word  processing,  spreadsheet,  or  other  application 
software,  but  only  six  reported  that  they  had  any  knowledge  of 
programming  in  BASIC,  Pascal,  or  Logo. 


Instrumentation 

Cognitive  strvle 

Cognitive  style  was  measured  by  the  Group  Embedded  Figures  Test 
(Oltman,  Ruskin,  &  Witkin,  1971).    Subjects  were  presented  with  a  comple: 
figure  and  were  asked  to  find  a  simple  figure  embedded  in  the  complex 
one.    The  tests  were  10  minutes  long,  and  consisted  of  18  complex 
pictures.    Scores  could  range  from  a  perfect  18  correct  to  zero  correct. 
A  high  score  indicates  field- independence  while  a  low  score  indicates 
field-dependence.    Test  validity  and  reliability  have  been  established 
for  the  GEFT  (Witkin,  Oltman,  Raskin,  &  Karp,  1971).    Using  correlations 
between  parallel  forms,  a  reliability  estimate  of  .82  was  determined. 


Cognitive  ability 

The  three  cognitive  ability  tests  were  timed,  paper-and-pencil 
tests,  and  all  were  selected  from  a  Kit  of  Factor-Referenced  Cognitive 
Tests  (Ekstrom,  French,  and  Harman,  1976).    Because  of  time  constraints, 
only  Part  A  of  each  test  was  used  in  this  study.    The  manual  stated  that 
these  tests  were  valid  for  grades  9  through  adults. 

Spatial  ability  was  measured  by  the  Paper  Folding  Test.    In  this 
test,  figures  were  drawn  to  show  each  step  of  paper  folding.    The  last 
figure  contained  one  or  two  holes  to  indicate  where  the  paper  had  been 
punched.    Subjects  were  asked  to  choose  one  of  five  figures  that  showed 
the  correct  pattern  of  hole  punches.    The  test  was  3  minutes  long  and 
consisted  jf  10  items. 
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Logical  reasoning  was  measured  by  the  Letter  Sets  Test.    B*ive  sets 
of  letters  were  presented  with  four  letters  in  each  set.    Four  of  the 
sets  were  alike  in  some  way.    Students  were  asked  to  find  the  odd  set. 
The  test  was  a  7-minute  timed  test  and  consisted  of  15  items.  The 
reliability  of  the  test  was  .77. 

Direction  following  ability  was  measured  by  the  Following  Directions 
test.    Subjects  were  asked  to  determine  the  correct  letter  in  a  matrix  of 
letters  by  following  a  complex  set  of  directions  (e.g.    "Which  is  the 
only  letter  that  appears  directly  above  the  letter  A?").    The  test  was  7 
minutes  long  and  consisted  of  10  items. 

^^^grflimtTTg  competence  measure 

Four  progranming  tests  were  given  throughout  the  treatment  period. 
Each  test  included  items  to  assess  knowledge  of  syntax,  ability  to 
interpret  a  program  (comprehension),  ability  to  design  and  generate  codes 
(composition) ,  ability  to  find  mistakes  in  the  existing  program 
(debugging) ,  and  the  ability  to  restructure  a  given  program  by  adding  or 
changing  codes -(modification) .    Each  test  included  the  five  component 
skills.    For  example,  to  test  syntax  knowledge,  students  needed  to 
recognize  BASIC  syntax  in  a  list  of  correct  and  incorrect  statements.  To 
test  comprehension,  students  predicted  outcomes  from  a  short  program  (6 
to  20  lines) .    To  test  program  composition,  students  were  asked  to 
generate  a  program  after  reading  one  or  two  paragraphs  which  described  a 
problem  to  be  solved.    To  test  program  debugging,  students  had  to  find 
and  correct  mistakes  in.  both  syntax  and  logic.    To  test  program 
modification,  a  function  of  an  existing  program  was  provided  and  students 
were  asked  to  add  more  progra  ning  codes  to  produce  different  outcomes . 

Each  item  for  programming  comprehension,  composition,  debugging,  and 
modification  was  scored  on  a  scale  of  0  to  10,  making  partial  credit 
possible.    Construct  validity  was  determined  by  asking  three  programming 
instructors  to  act  as  judges.    They  were  asked  to  identify  the  category 
of  each  question  based  on  criteria  provided  by  the  researcher.  The 
interjudge  agreement  was  100%  for  syntax,  comprehension,  and  composition, 
and  93%  on  debugging  and  modification. 

Procedure 

Course  content  consisted  of  computer  application,  issues  in 
educational  computing,  and  BASIC  programming.    Four  cognitive  pretests, 
measuring  cognitive  style  and  ability,  were  administered  during  the  3rd 
week  of  the  semester.    BASIC  programming  began  during  the  fourth  week. 
Four  tests  were  given  to  students  during  the  9 -week  treatment  period. 
Programming  tests  were  given  at  intervals  for  two  reasons:  First,  in 
order  to  increase  the  reliability  of  subskill  tests,  several  items  for 
each  component  skill  had  to  be  asked.    Students  would  be  overwhelmed  with 
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one  test.    Second,  tests  served  as  an  instructional  activity  as  well  as 
an  evaluation  tool. 

During  the  instructional  treatment  period,  students  were  guided  by 
lecture  and  a  textbook  (Computer  Literacy:  A  Hands -On  Approach,  Luehrmann 
&  Peckham,  1986)  •    Program  design,  debugging,  and  modification  skills 
were  emphasized  as  students  learned  programming  concepts.    In  addition  to 
in- class  work,  five  programming  assignments  were  required  for  a  course 
grade. 

Data  Analysis  and  Results 

Out  of  46  subjects,  45  completed  all  cognitive  pre- tests  and  all 
programming  exams.    Field- independence  was  treated  as  a  continuous 
variable  rather  than  a  dichotomous  variable.    Logical  reasoning,  spatial 
ability,  and  direction  following  were  scored  by  counting  correct  answers. 
A  scoring  scheme  was  developed  for  computer  programming  items.  Syntax 
answers  were  judged  either  true  or  false,  not  allowing  for  partial 
credit."    Scores  in  other  categories  were  graded  on  a  scale  of  0  to  10,  so 
that  partial  credit  could  be  given  for  partially  correct  answers. 

To  examine  the  relationships  between  cognitive  variables  and 
computer  prograjmning  competence,  intercorrelations  among  computer 
programming  subscores,  cognitive  style,  and  cognitive  ability  are 
presented  in  Table  1. 


Insert  Table  1  here 


Field- indepentence  was  moderately  related  to  all  of  the  computer 
programming  competence  scores  (p  <.01).    Logical  reasoning  and  direction 
following  were  significantly  related  to  most  computer  programming  skills 
except  the  syntax  score  (p<.001).    Spatial  ability  was  related  to 
programming  debugging  and  modification  in  this  study.    Previous  findings 
of  a  positive  relationship  between  spatial  ability  and  computer 
progranmiing  success  was  based  on  a  composite  score  (Snow,  1980;  Mayer, 
Dyck,  &  Vilberg,  1986).    Tnerefore,  it  is  difficult  to  compare  previous 
findings  to  findings  in  thxs  study.    It  is  interesting  that  spatial 
ability  is  related  only  to  those  skills  considered  complex  (debugging, 
modification).    It  is  reasonable  to  assume  that  the  ability  to  transform 
one  image  into  another  may  be  important  in  debugging  and  changing 
programs. 

Although  the  focus  of  this  study  was  to  determine  the  relationship 
between  cognitive  variables  and  computer  programming  competence. 
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intercorrelations  were  also  examined  in  order  to  examine  the  effect  of 
these  factors  upon  learning  computer  programming. 

Field- independence  is  related  to  the  other  three  cognitive  ability 
variables •    Spatial  ability  is  related  to  only  field- independence. 
Reasoning  is  related  to  field- independence  and  direction  following. 
Direction  following  is  related  to  field- independence  and  logical 
reasoning.    The  strong  relationship  between  direction  following  and 
logical  reasoning  may  imply  that  these  two  variables  were  strongly 
related  to  all  programming  skills  except  the  knowledge  of  syntax. 

Relationships  between  cognitive  style/cognitive  abilities,  and  the 
initial  acquisition  of  computer  programming  competence  were  examined. 
Four  conclusions  were  drawn  from  data.    (1)  Logical  reasoning  and 
direction  following  were  strongly  related  to  program  comprehension, 
composition,  debugging,  and  modification.    (2)  Spatial  ability  is  only 
related  to  debugging  and  modification,  (3)  Cognitive  style  is  moderately 
related  to  all  of  the  five  programming  skills:  Syntax,  comprehension, 
composition,  debugging,  and  modification.      (4)  Cognitive  style  is 
related  to  knowledge  of  syntax  but  cognitive  ability  is  not  related  to 
knowledge  of  syntax. 

Based  on  Shneiderman^ s  syntactic  and  semantic  model,  programming 
component  skills  were  subdivided  to  examine  the  relationship  between  the 
4  cogi.itive  variables  and  the  5  computer  programming  component  skills.  A 
strong  relationship  betvreen  logical  reasoning  and  programming  coincides 
with  previous  findings  (Mayer, 7)yck,&  Vilberg,  1986).    This  suggests  that 
logical  reasoning  is  similar  to  processes  that  are  required  in 
programming.    According  to  Wardell  (1973),  induction  is  largely  a 
synthesizing  process.    Program  composition,  debugging,  and  modification 
require  the  assembling  of  program  statements  into  a  logically  sequenced 
program  list.    However  most  novice  programmers  find  it  more  difficult  to 
write  or  debug  programs  than  to  learn  language  features  (Linn,  1985). 
Findings  of  a  positive  relationship  between  logical  reasoning  and  all 
programming  skills  but  syntax  seem  reasonable,  since  the  knowledge  of 
syntax  is  acquired  by  rote  learning  rather  than  by  applying  a 
synthesizing  process. 

A  positive  relationship  between  direction  following  and  programming 
is  expected  because  programming  involves  procedural  skills  such  as 
sequencing  and  tracking  statements.    Direction  following  is  referred  to 
"integrative  process-  which  is  an  ability  to  keep  in  mind  simultaneously, 
or  to  combine  several  conditions  to  produce  a  correct  response  (Ekstrom, 
French,  &  harman,  1975).    Program  comprehension,  composition,  debugging, 
and  modification  require  close  tracking  of  function  of  statements  as  well 
as  their  relationship  to  othor  statements.      Finding  of  a  relationship 
between  direction  following  and  programming  is  particulary  valuable, 
because  following  directions  is  a  specific  skill  that  may  be  trainable 
than  skills  of  general  ability  (Mayer,  Dyck,  Vilberg,  1986).  Since 
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direction  following  (a  procedural  skill)  seems  related  to  success  in 
learning  to  program,  procedural  skills  may  be  developed  through 
instruction.    Although  procedural  skills  are  employed  in  many  problem 
solving  situations,  these  skills  are  not  explicitly  taught  in  schools.  A 
nonsignificant  relationship  with  sjmtax  and  direction  following  is  also 
expected  because  knowledge  of  syntax  is  acquired  by  rote  learning. 

Field- independence  was  ipoderately  related  to  all  of  the  five 
progranmiing  components.    The  similarity  between  cognitive  processes  which 
field- independent  learners  employ  and  cognitive  processes  that  are 
required  for  programming  anticipates  a  positive  correlation  between  the 
two.    Indeed,  several  studies  have  reported  a  positive  relationship 
between  field- independence  and  programming  (Webb,  1984;  Bradley,  1986; 
Werth,  1986).    Webb  (1985)  and  Bradley  (1986)  found  that  field- 
independence  wat^  related  to  LOGO  programming  achievement  scores  with 
small  children.    Werth  (1986)  found  a  significant  relationship  between 
fields independence  and  PASCAL  programming  success.    The  current  study 
found  a  relationship  between  field- independence  and  the  acquisition  of 
initial  programming  competence  in  BASIC  with  adults.    In  spite  of 
different  languages  and  age  groups,  the  consistent  positive  relationship 
between  programming  and  field- independence  suggests  that  "cognitive 
restructuring"  is  important  in  learning  to  program.    Data  from  the 
current  study  also  suggests  that  field  independence  seems  to  underlie 
other  cognitive  abilities  because  of  the  significant  correlation  between 
GEFT  scores  and  logical  reasoning,  spatial,  and  direction  following. 

A  positive  relationship  was  found  between  spatial  ability  and 
programming  debugging  and  modification.    The  current  study  findings  on 
the  relationship  between  spatial  and  other  component  skills  (s3mtax, 
comprehension,  composition)  do  not  support  Webb's  findings  (1984). 
However,  she  used  LOGO  language  to  examine  the  relationship  between 
spatial  ability  and  the  acquisition  of  syntax,  program  interpretation, 
and  program  generation.    It  is  possible  that  adults  recognize  BASIC 
syntax  more  easily  than  precollege  students,  because  a  significant 
relationship  was  found  between  spatial  ability  and  more  cognitivly 
demanding  tasks  such  as  program  debugging  and  modification.    Also,  the 
conflicting  results  on  program  comprehension  and  composition  between 
Webb's  study  and  the  current  study  may  be  due  to  different  languages 
used. 

In  summary,  field- independence,  logical  reasoning,  spatial  ability, 
and  direction  following  were  fcand  to  be  related  to  computer  programming. 
The  importance  of  logical  reasoning  and  direction  following  have  been 
found  in  this  study.    The  lack  of  a  relationship  between  the  knowledge  of 
syntax  and  cognitive  ability  should  be  investigated  further  in  future 
studies. 
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Table  1 

Intercorrelations, Among  Computer  Programming  Subscores.  Cognitive  Style,  and 
Cognitive  Ability 


Syntax 

Compre 

Conpo 

Debug 

Modlf 

Style  Spatial 

Reason 

style 

.279* 

.359** 

.385** 

.430** 

.371** 

Spatial 

.027 

.236 

.250 

.288* 

.323* 

.434** 

Reason 

.221 

.640*** 

. 528*** 

.537*** 

.532** 

.468***  .231 

Direction 

.244 

.600*** 

.570*** 

.505*** 

.462** 

.365**  .188 

.642*** 

Note;  N-46 

*  p  < 

.05  ** 

p  <  .01 

***  p  < 

.001 
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"Our  minds  encompass  planetary  movements,  mark  out  geological  eras,  resolve 
matter  into  its  constituent  electrons,  because  our  mentality  is  the 
transcendental  expression  o-f  the  age-old  integration  between  ectoplasm  and 
non-1  i V i ng  world. " 

Earnest  Everett  Just,  Biologist 

"We  cannot  doubt  the  existence  o-f  an  ultimate  reality.    It  is  the  Universe 
■forever  masked.    We  are  a  part  o-f  an  aspect  o-f  i  t ,  and  the  masks  -figured  by 
us  are  the  Universe  observing  and  understanding  itsel-f  -from  a  human  point  o-f 
V  i  ew . " 

Edward  Harrison,  Cosmologist 

"The  passion  -for  science  and  the  passion  -for  music  are  driven  by  the  same 
desire:  to  realize  beauty  in  one's  vision  o-f  the  world." 

Heinz  Pagels,  Physicist 


Introduct  ion 

Science  has  long  -fingers.    Because  it  re-flects  a  way  o-f  thinking,  it 
-frames  our  imagination,  our  investigation,  and  our  invention.    The  questions 
we  ask,  the  nanner  in  which  we  derive  answers,  and  the  eventual  solutions 
proposed  +o  problems  all  become  exemplifications  o-f  the  current  scienti-fic 
mode  o-f  thinking.  Thus,  science  in-fluences  our  technology,  our  politics,  our 
research,  and  our  institutions. 

It  is  a  commonly  held  assumption  today  that  education  should  be  a 
science.    Point  in  -fact,  most  universities  and  colleges  o-f  education  bestow 
the  degree  o-f  B.S.,  rather  than  B.A.  on  their  graduates.    Implicit  in  such  an 
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assumption  is  the  belief  that  the  products  and  processes  of  science  and 
technology  can  provide  benefits,  if  not  solutions,  to  the  problems  in  ths 
field  of  education.    Yet,  science  has  undergone  some  major  paradigmatic 
changes  during  this  century  that  need  careful  examination  if  educators  are  to 
attempt  to  apply  principles  from  it. 

This  article  begins  with  an  overview  of  the  changes  in  science, 
specifically  physics,  and  ends  with  the  proposition  that  education  is 
currently  entrenched  with  an  outdated  scientific  mode  of  thought,  that  of  a 
Newtonian  model.    It  proposes  that  the  more  contemporary  model  of  relativity 
be  applied  which  purports  that  wholes  can  not  be  broken  into  parts,  variables 
are  not  isolable  but  interrelated,  and  that  change  is  a  dance  of  i  ntei  .2ct  i  on , 
organization,  and  adaptation. 


Brief  History  of  Science 

During  the  Middle  Ages  science  was  based  on  a  unification  of  reason  and 
faith,  its  main  gual  being  to  understand  the  meaning  and  significance  of 
natural  phenomena.    God,  th?  human  soul,  and  ethics  were  interwoven  into  a 
view  of  the  world  as  organic  and  living  because  causal  explanation  and  human 
or  divine  purpose  were  confused  and  superficial. 

With  the  advent  of  the  "Age  of  the  Scientific  Revolution"  in  the 
sixteenth  and  seventeenth  centuries,  a  rigorous  determinism  became  prevalent 
with  objective  relationships  attributed  to  causal  events,  epitomized  by  the 
theories  of  Bacon,  Descartes,  and  Newton.    Bacon  advanced  the  notion  that 
"nature  had  to  be  hounded  in  her  wander i ngs. . .bound  into  service  and  made  a 
slave"  <Capra,  1982,  pg.54).    He  set  forth  the  empirical  method  of  induction, 
the  expressed  goal  being  to  dominate  and  control  nature.    Descartes,  with  his 
famous  idiom  "Cogito,  ergo  sum"  —  "I  think,  therefore  I  exist"  encouraged  a 
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division  between  mind  and  matter  which  led  to  a  view  o-f  the  universe  ?.5  s 
mechanical  system  consisting  o-f  separate  objects,  -fundamental  building  blocks 
whose  properties  and  interactions  were  thought  to  determine  all  natural 
phenomena.  A  brilliant  philosopher  and  mathematician,  Descartes  -formulated 
the  principles  of  deductive  reasoning  and  set  -forth  the  -framework  o-f  the 
cartesian  coordinate  system,  both  o-f  which  became  the  basis  -for  a 
reductionist,  empiricist  view  o-f  the  world.    Newton  cemented  this  perspective 
by  describing  space  and  time  as  "absolute...  without  regard  to  anything 
external"  (Capra,  1982,  pg.    65).    Hi s  mechan i cs  were  based  on  certain 
principles  oi  conservation  which  produced  the  idea  that  all  that  happened  had 
a  definite  cause  and  effect,  and  that  the  future  of  any  part  of  a  system 
could  be  determined  with  absolute  certainty  if  its  present  state  was  known  in 
detail  and  the  appropriate  measurement  tools  were  available. 

Contemporary  physics  suggests  a  new  paradigm.    For  example,  Faraday  and 
Maxwell  while  studying  electric  and  magnetic  forces  discovered  that  i t  made 
more  sense  to  talk  about  a  "force  field"  rather  than  a  force.  They 
determined  that  each  charge  created  a  disturbance  in  the  spaco  around  it  so 
that  the  other  charge  felt  a  force.    In  contrast  to  Newton's  theory,  the 
force  field  had  its  own  reality  and  could  be  studied  without  any  reference  to 
material  bodies. 

During  the  1800's  light  uas  believed  to  be  composed  of  waves.  Thomas 
Young  had  shown  convincingly  that  when  a  beam  of  light  was  projected  through 
a  razorlike  slit  <smaller  in  diameter  than  the  wavelengh  of  the  light), 
interference  <diffraction)  occured.    This  diffraction  could  only  be  explained 
by  a  wave  theory.    Plantk  and  later  Einstein  proved,  in  contradiction  to 
Young's  theory,  that  light  was  composed  of  small  particles  (called  photons) 
travelling  in  a  similar  fashion  to  billiard  balls.    When  they  hit  an  object 
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they  hit  an  object  they  knocked  a  particle  out  oi  the  mass  oi  that  object, 
just  as  a  billiard  ball  hitting  another  would  send  it  traveling  at  the  same 
speed  as  the  original  ball.    This  pro;/Osa1  explained  refraction  and  the 
photoelectric  effect,  whereas  the  wave  interpretation  had  been  insufficient, 
but  a  paradox  remained.    How  could  light  be  particles  with  mass,  and  yet  be 
waves  at  the  same  time?    Einstein  resolved  the  contradiction,  by  proving  that 
light  was  both.    He  proposed  that  light  is  nothing  but  a  rapidly  alternating 
electromagnetic  field  traveling  through  space  in  the  form  of  waves.  Whether 
we  perceive  light  as  photons  (having  mass)  or  a^  waves  depends  on  the 
observer,  the  question  asked,    and  the  measurement  system  used.  Sachs 
comments  on  Einstein's  theory,., 

"The  real  revolution  that  came  with  Einstein's  theory. ..was  the 
abandonment  of  the  idea  that  the  space-timr*  coordinate  system  has 
objective  significance  as  a  separate  physical  entity.    Instead  of  this 
idea,  relativity  theory  implies  that  the  space  and  time  coordinates  are 
only  the  elements  of  a  language  that  is  used  by  an  observer  to  describe 
his  environment."  <Sachs,  19<59,  pg.  53) 

Present  day  quantum  physicists  have  verified  repeatedly  Einstein's 
description  of  th.  effect  of  the  observer  and  the  interconnectedness  of 
variables  such  as  space,  time,  and  momentum.    Subatomic  particles  have  been 
found  by  Heisenberg,  Bohr  and  others  to  have  no  meaning  as  isolated  entities. 
To  the  extent  that  a  particle  can  be  studied  in  terms  of  Ws  placement  in 
the  atom,  the  momentum  becomes  ambiguousc    And  vice-versa.    In  other  words 
particles  are        understood  as  waves  dancing  between  states  of  mass  and 
energy.  In  the  words  of  Neil  Bohr,  "Isolated  material  particles  are 
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abstractions,  their  properties  being  definable  and  observable  only  through 
their  interaction  with  other  systems"  (Capra,  1984,  pg.  124). 

Presenv  day  "Bootstrap"  and  "S-Matrix"  theory  physicists  assert  an  even 
more  radical  perspective.    In  Capra^s  words. 


world  view  in  modern  physics. ..In  the  new  world  view,  the  universe  is  seen 
as  a  dynamic  web  of  interrelated  events.    None  of  the  properties  of  any 
l*art  of  this  web  is  fundamental;    they  all  follow  from  the  properties  of 
the  other  parts,  and  the  overall  consistency  of  their  mutual 
interrelations  determines  the  structure  of  the  entire  web."  (1982,  pg.  93) 

In  essence,  bootstrap  philosophy  accepts  no  laws  at  all  except  that  of  self-- 
consistency.    All  the  parts  of  matter  must  be  consistent  with  each  other. 
To  that  point  Heisenberg  states,  (when  we  observe)..  "What  we  observe  is  not 
nature  itself,  but  nature  exposed  to  our  method  of  questioning." 

The  concept  of  mass  as  nothing  but  a  form  of  energy,  and  particles,  not 
as  building  blocks,  but  as  "dynamic  patterns  continually  changing  into  one 
another—the  continuous  dance  of^energy"  has  led  some  (Capra,  1982,  1976; 
Zukav,  1979)  even  to  go  so  far  as  to  suggest  a  parallel  between  current 
physics  models  and  eastern  mysticism,  i.e.    Taoism.    In  Taoism,  change  is  not 
seen  as  occurring  as  a  consequence  of  some  force,  but  rather  as  a  tendency 
which  is  innate  in  all  things  and  situations,  arising  from  the  dynamic 
interplay  between  the  polar  abstractions  of  yin  and  yang. 

Yin  can  be  understood  metaphorically  by  equating  it  to  the  earth*  moon, 
night,  winter,  interior.    It  corresponds  to  all  that  is  contractive, 
responsive,  and  conservative  and  is  sometimes  related  to  the  more  feminine 


"Bootstrap  philosophy  constitutes  the  final  rejection  of  the  mechanistic 
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side  o-f  nature,  meaning  receptive,  re-flective,  and  intuitive. 

Yang,  on  the  other  hand,  can  be  associated  with  heaven,  sun,  day, 
sunmter,  sur-face.    It  implies  all  that  is  expansive,  aggressive,  and 
iemanding,  and  serves  as  the  masculine  counterpart  o-f  nature,  meaning 
assertive  and  controlling. 

Waves  dancing  to  become  mass  exompli-fy  the  yin  pole;  the  expansive  dance 
to  become  energy,  the  yang.    The  more  electrons  are  constrained  by  a  "yin" 
pull,  the  -faster  and  -faster  they  dance  <yang).    The  contractual  pull  gets 
complemented  by  the  momentum  and  expansion  pull,  keeping  the  atom  in  optimal, 
dynamic  equilibrium.    These  "pulls"  are  not  exterior  -forces  but  arise  out  o-f 
the  inherent  nature  o-f  matter.    Just  as  the  mystics  speak  of  too  much  o-f 
either  po^e  as  destructive,  so  too  contemporary  physicists.    UhiVe  too  much 
contraction  results  in  black  holes,  too  much  expansion  results  in  burning 
suns. 


In-f luence  o-f  Early  Science  on  Educat ion 
This  new  scienti-fic  world  view  is  vastly  di-f-ferent  than  the  one  utilized 
in  education  today.    To  date,  although  many  di-f-ferent  models  have  been  tried, 
they  all  sesm  to  stem  -from  two  basic  perspectives,  either  empiricism  or 
maturation  ism.    While  empiricists  rely  too  heavily  on  a  controlled,  Newtonian 
view,  maturationists  can  be  criticized  -for  their  sole  reliance  on  the 
internal,  natural  development  o-f  the  child,  a  view  reminiscent  o-f  early 
science. 


Emp  i  r  i  c  i  sm 

Definition.    Empiricism  is  de-fined  b^'  Webster  as  "the  theory  that  c»M 
knowledge  originates  in  experience".    Geneially,  e;7ipiricists  hold  that 
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knowledge  is  a  copy  of  a  world  exterior  to  the  seH.    Stimuli  effect  the 
learner  and  are  processed.    Each  experience  or  observation  adds  to  prior 
ones,  thus  knowledge  is  the  sum  total  of  observations  the  learner  has  had. 
No  a  priori  thought  on  the  part  of  the  learner  is  assumed.    Empiricism  is 
frequently  equated  to  logical  positivism  which  holds  that  all  meaningful 
statements  are  either  analytic  or  conclusively  verifiable  or  at  least 
ccnfirmable  by  observation  and  experiment. 

Empiricism  in  education.    The  empiricist  viewpoint  in  education  takes 
the  form  of  preplanning  a  curriculum  by  breaking  a  content  area  or  skill  into 
assumed  component  parts  or  subskills  and  then  sequencing  these  parts  into  a 
hierarchy  ranging  from  simple  to  more  complex.    It  is  assumed  that 
observation  or  experience  at  each  of  these  sub  levels  will  quantify  to 
produce  the  whole,  or  more  general  concept.    Further,  learners  are  viewed  as 
passive,  in  need  of  motivation,  and  effected  by  reinforcment.  Thus,  teachers 
spend  their  time  developing  a  sequenced,  well  structured  curriculum  and 
determining  how  they  will  asssss,  motivate,  reinforce,  and  evaluate  the 
learner,  before  they  have  even  met  him/her!    The  child  is  simply  tested  to 
see  where  he/she  falls  on  the  curriculum  continuum  and  then  expected  to 
progress  in  a  continuous,  quantitative  fashion. 

Bloom's  mastery  learning  model  is  a  case  in  point.    This  model  makes  the 
assumption  that  wholes  can  be  broken  into  parts;  that  skills  can  be  broken 
into  subskills.    Learners  are  diagnosed  as  to  the  level  or  subskill  needed, 
then  taught  until  mastery  is  achieved  at  each  level.    Further,  it  is  assumed 
that  if  mastery  is  achieved  at  each  level  then  the  more  general  skill 
en^ompessing  the  parts  hav  also  been  taught.  Learners  are  assessed  at  each 
stage,  because  in  true  logical  positivist  fashion  it  is  believed  that 
learning  can  be  conclusively  verified  by  observation  and  experiment.  The 
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effect  of  simply  asking  a  question,  or  testing,  is  rarely  considered,  or  if 
considered  is  usually  cast  empirically. 

Problems.  A  recent  study  in  the  Chicago  Public  School  System  (1985) 
found  an  empiricist  educational  technology  to  have  some  problems.  The  Chicago 
schools  adopted  a  master/  learning  approach  in  their  reading  instruction 
programs,  K  -  6.    The  subskills  such  as  beginning  consonant  sounds,  vowel 
sounds,  ending  consonant  sounds,  consonant  blends,  vowel  digraphs,  and 
comprehension  were  taught  in  a  structured,  sequenced  manner  until  mastery  w?:> 
achieved  at  each  level.    Teachers  found  that  in  the  first  few  years  of  the 
program  reading  achievement  scores  increased.    By  sixth  grade  however  an 
interesting  fact  was  observed.    Although  reading  scores  were  high  on 
achievement  tests,  upon  entering  junior  high,  reading  levels  decreased.  In 
fact,  learners  actually  were  found  to  not  be  reading.    A  research  group 
brought  in  to  study  the  problem  found  that  although  learners  were  scoring 
high  on  achievement  tests,  the  tests  were  only  measuring  what  had  actually 
been  taught,  i.e.  the  subskill  or  component  part  covered.    Learners  in  fact 
were  spending  most  of  the  allotted  language  arts  time  completing  dittoes  or 
workbook  pages  related  to  the  subskill,  but  were  spending  only  a  few  minutes 
a  day  actually  reading!    Although  they  had  mastered  each  component  skill  in 
isolation  they  were  still  not  reading  for  meaning,  enjoyment,  or  information. 
To  wit,  the  parts  did  not  necessarily  add  up  to  the  whole;  the  whole  was  in 
fact  larger  than  the  parts. 

I^ost  elementary  and  secondary  schools  take  an  empiricist  perspec*  oe  in 
their  curriculum  planning.    Fields  are  isolated  and  categorized  as  if  they 
were  really  separate  entities,  e.g.  science,  math,  reading,  etc,  and  then 
they  compete  with  each  other  for  time  in  the  overall  curriculum.  Subskills 
are  identified,  and  sequenced  into  preplanned  curricula.    Learners  are 
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diagnosed,  motivated,  rein-forced,  and  posttested.    The  role  o-f  the  teacher 
has  become  one  o-f  technician:    diagnose  the  needs  o-f  the  learner  then  present 
the  correct  sequence  o-f  objectives  in  the  correct  instructional  mode.  Even 
the  teacher  r?ts  evaluated.    Not  only  are  the  students'  test  scores  used  to 
validate  what  they  have  learned,  but  in  some  circles  they  are  even  considered 
an  appropriate  mec^sure  o-f  the  teacher's  per-formance ! 

The  implicit  assumptions  are  obvious;  parts  add  up  to  wholes  and 
variables  can  be  controlled  and  isolated  given  enough  in-formation  and 
-appropriate  measuring  tools.    To  wit,  the  technolon/  has  been  too  "yang",  too 
assertive,  too  reminiscent  o-f  tho  science  o-f  Bacon,  Descartes,  and  Newton. 
Little,  or  no,  emphasis  is  placed  on  the  a  priori  thought  o-f  the  child. 
Instead  the  -focus  h'"s  been  on  the  teacher's  behaviors  and  the  curriculum,  on 
control  o-f  the  learning  situation  and  the  learner.    Only  one  person  has  been 
dancing,  the  teacher. 

Maturation  ism 

De-f  inition.  The  maturationist  perspective,  on  the  other  hand,  takes  the 
stance  that  the  innate  program  o-f  development  is  o-f  pri«ne  importance.  All 
emphasis  is  placed  on  the  child.    Un-folding  and  growth  are  assumed  to  occur 
by  biological  programming. 

liaturationism  in  education.    The  educator's  role  is  siinply  to  prepare  ai 
enriched,  developmental ly  appropriate  environment.    Gcsell,  Ilg  and  Ames,  and 
Rousseau  are  representatives  o-f  this  perspective.    Rousseau  long  ago  wrote 
about  the  -flowering  o-f  Emile.  suggesting  that  the  child  is  innately  good  and 
simply  needs  an  appropr i at<j ,  kind  environment  to  blossom  to  his  tull 
potential.    Similarly  xhe  Gesell  school  suggests  testing  learners  in  relation 
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to  developmental  milestones  and  onJy  placing  them  in  a  school  environment 
when  they  are  ready.    Maturation  is  viewed  as  innately  governed,  an  unfolding 
process  not  to  be  tampered  with.    Curriculum  planning  takes  the  -form  of 
assessing  the  developmental  level  of  the  child  and  then  planning  appropriate 
activities  at  that  level . 

P^Qbl^ms,     Education  viewed  from  this  perspective  eventually  arrives  at 
a  dilemma,  aptly  described  by  Eleanor  Duckworth  <1987)  in  the  title  of  her 
article,  "Either  they  know  it  already  and  we^e  too  late,  or  we're  too  early 
and  they  can't  learn  it  anyway."    Education  dissolves  to  a  game  of  constant 
assessment  and  matching,  and  leaves  the  question  of  how  to  help  learners  "get 
ready"  unanswered. 

Whereas  most  elementary  and  secondary  programs  have  been  influenced  by  a 
"Newtonian"  science,  most  early  childhood  progratjs  (as  well  as  many  of  the 
past  "romantic"  and  "free"  schools)  have  been  entrenched  with  maturationism. 
The  role  of  the  educator  has  been  to  prepare  the  environment  and  withdraw,  to 
let  I'^arning  occur  at  its  own  pace  through  experience  and  play.    In  placing 
full  emphasis  on  the  "unfolding"  growth  of  the  child,  they  have  utilized  a. 
technology  too  "yin",  a  view  soFnewhat  reminiscent  of  the  early  science  where 
the  goal  was  to  understand  the  meaning  and  significance  of  natural  phenomena, 
rather  than  to  control  them.    To  wit,  the  teacher  has  attempted  to  understand 
the  natural  growth  processes  of  the  child,  prepared  an  environment  conducive 
to  the  dancing  child,  and  then  become  the  audience. 


A  New  Model"  The  Dance  of  Construction 
Capra,  in  The  Turning  Point  (1982),  uses  this  new  world  view  of 
relativity,  not  only  to  define  technology,  but  to  reflect  on  society,  its 
institutions,  and  the  rising  culture.    He  states, 
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"Many  (o-f  today's  physicists)  actively  support  a  society  which  is  still 
based  on  the  mechanistic,  -fragmented  world-view,  without  seeing  that 
science  points  beyond  such  a  view,  toward  a  oneness  o-f  the  universe  which 
includes  not  only  our  natural  environment  but  also  our  -fellow  human 
be  ings." 

The  rise  in  nuclear  armaments  and  our  present  economic  and  medical  models  are 
viewed  by  Capra  as  residual  o-f  a  "Newtonian  technology".    Wh(  *es  are 
dissected,  problems  with  parts  are  diagnosed,  ctnd  solutions  are  proposed  with 
no  eye  towards  the  relatedness  o-f  the  parts,  ncr  the  e-f-fect  o-f  the  observer. 
He  continues, 

"The  yang,  masculine  consciousness  that  dominates  our  culture  has  found 
its  fulfillment  not  only  in  'hard'  science  but  also  in  the  'hard' 
technology  derived  from  it.    This  technology  is  fragmented  rather  than 
holistic,  bent  on  manipulation  and  control  rather  than  cooperation,  self- 
assertive  rather  than  integrative,  and  suitable  for  centralized  management 
rather  than  regional  application  by  individuals  and  small  groups.    As  a 
result,  this  technology  has  become  profoundly  antiecological ,  antisocifil, 
unhealthy,  and  inhuman.    What  we  need  is  a  redefinition  of  the  nature  of 
technology,  a  change  of  its  direction,  and  a  reevaluation  o-f  its 
underlying  value  system.    If  technology  is  understood  in  the  broadest 
sense  of  the  term,  as  the  application  of  human  knowledcje  to  the  solution 
of  practical  problems,  it  becomes  clear  that  we  have  concentrated  too  much 
on  'hard'  highly  r  ^  resource-intensive  technologies  and  must  now 

shift  our  attention  to  the  'soft'  technologies  of  conflict  resolution, 

u  271 


social  agreements,  cooperation,  recycling,  and  redistribution.  As 
Schumacher  says  in  his  boc^  Small  is  Beautiful^  we  need  a  'technology  with 
a  human  face' ." 

The  new  science  model  suggests  a  new  technology  of  education,  one  of  an 
organic/systems  approach.    A  .'niudle  ground  position  is  needed,  more  yin  than 
yanq,  more  yang  than  yin.    If  motion  and  change  are  essential  properties  of 
things  and  the  forces  causing  the  motion  are  not  outside  the  objects  but  are 
an  intrinsic  property  of  matter,  then  learning  and  behavi  ''^al  change  become 
understood  as  self-regu.ated  behavior  of  the  child  as  she  interacts  with  the 
environment.    The  teacher  must  seek  to  promote  growth.    She  can  be 
facilitative  of  thi?.  process,  but  she  cannot  force  it.    She  must  dance  with 
the  child,  at  times  in  unison,  at  times  creating  dissonance.  Piagst's 
proposed  mechanism  of  learning,  equilibration,  provides  an  interesting 
solut  i  on. 


Biological  equil ibration. 

In  order  to  fully  understand  equilibration,  a  discussion  of  Piaget's 
early  work  with  snails  will  be  helpful.    Piaget's  fascination  centered  around 
the  variability  of  the  snaiTs  adaptation.    He  studied  tiree  separate  groups 
of  Limnaea  stagnalis  (see  figure  1):  those  that  live  in  still,  tranquil 


Place  figure  1  here. 


waters  (habitat  A),  those  that  live  in  mildly  disturbed,  waters  agitated  by 
waves  (habitat  B) ,  and  those  that  live  in  severely  disturbed  waters  agitated 
by  high  winds  and  waves  (habitat  C) .    While  the  shape  of  the  snail  in  calm 
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water  was  elongated,  the  shape  of  the  snails  in  the  agitated  water  was 
globular  and  curved.    Piaget  believed  ihat  the  globular  shape  wv.s  due  to  the 
activity  o-f  the  snails. 

"the  animal  in  the  course  oi  its  growth  attaches  itseH  to  its  solid 
support,  which  dilates  the  opening.    At  the  same  time  and  even  because  of 
this,  it  draws  on  the  muscle  that  attaches  it  to  its  shell,  and  this  tends 
to  shorten  the  spine  ,i.e.  the  upper  part  of  the  spiral  shell*'  <Gallagher 
and  Reid,  pg.    22,  1982). 
The  interesting  aspect  that  Piaget  noticed  was  that  the  globular  snails 
of  habitat  B,  when  removed  and  placed  in  an  aquarium  (habitat  A)  had 
offspring  that  were  elongated!    This  showed  that  the  change  in  structure  was 
only  a  phenotypic  change,  not  a  permanent  genetic  change.    In  contrast  the 
snails  in  habitat  C,  although  they  looked  exactly  like  the  snails  in  habitat 
B,  showed  no  change  even  when  they  were  left  in  an  aquarium  for  16  years.  In 
other  words,  the  snails  in  habitat  C  were  distinctly  different,  having  a 
different  genotype. 

From  these  observations,  Piaget  proposed  a  middle  ground  position 
between  the  commonly  held  theories  of  Lamarck  and  Darwin.    Umarck  had  very 
early  suggested  that  evolution  wai*  a  result  of  the  organism's  adjustment  or 
accommodation  to  the  environment's  pressure.    In  other  wordi,  in  order  for  a 
species  to  survive  in  a  changing  environment  it  made  progressive  structural, 
genetic  changes.    For  years  scientists  cut  tails  off  rats  in  an  attempt  to 
produce  a  genetic  f  Vain  without  tails.    This  act  was  fruitlef>s  and 
eventually  Lamarck's  theory  was  disproven. 

Whereas  Lamarck  took  a  radical  empiricist  view,  Darwin  placed  heavier 
emphasis  on  the  organism.    He  proposed  that  evolution  was  due  to  random 
mutations  generated  by  the  organism.    Whichever  mutations  were  more  suited  to 
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the  environment  would  be  carried  on. 

Piaget  took  the  position  that  behavior  drives  the  evolution  oi  new 
structures  because  the  dev;^1opment  o'f  new  behavior,  more  or  less,  causes  an 
imbalance  in  the  gehomei  the  regulatory  system  o'f  the  genetic  structure  and  a 
new  adaptation  to  the  environment  is  constructed.    He  ^felt  that  both 
Lamarck's  and  Darwin's  theories  were  too  radical.    He  viewed  behavior  and  the 
organism  as  a  whole  system;  the  balance  between  the  structure  of  the  organism 
and  the  environment  were  all  interrelated  and  thus  indi ssoc i abl e .    Any  change 
in  a  part  o^  the  system  would  result  in  other  changes  as  behavior  balanced 
the  structure  oi  the  organism  against  the  characteristics  o-f  the  environment. 
Thus  Piaget  believed  that,  in  the  case  o-f  the  snail,  progressive 
reorganizations,  or  gradual  ch'nges  in  the  response  of  the  genome  to  the 
environment  and  the  activity  oi  the  organise  caused  *  a  genijtic  assimilation 
whereby  the  genome  entered  into  an  interaction  with  the  environment.  The 
final  result  is  the  process  of  biological  phenocopy:  the  replacement  of  an 
initial  phenotype  by  a  genotype  presenting  the  same  distinctive 
characteristics"  (Gallagher  ami  Reid,  1982,  pg.  22). 

Cooni  t i ve  equi 1 ibration 

Although  PUget's  early  work  was  in  the  field  of  biology,  most  of  his 
life  was  devoted  to  studying  the  genesis  of  cognitive  structures  and  relating 
this  process  to  his  early  work  in  biology. 

Structures^     A  structure,  according  to  Piaget,  is  a  system  ^ith  a  set 
of  laws  that  applies  to  the  system  as  a  whole  and  not  only  to  its  elements. 
Structures  are  characterized  by  three  properties:  wholeness,  transformation, 
and  self-regulation. 

Uhoieness  refers  to  the  fact  that  the  system  is  a  whole  that  may  in  fact 
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be  larger  than  the  sum  o,  its  parts.    The  parts,  interacting  and  related,  are 
indissociable  -from  each  other  and  the  whole  and  thus  have  no  meaning  by 
themselves.    Their  meaning  is  derived  only  in  terms  o-f  the  whole,  and  in 
relation  to  each  other. 

Trans-formation  explains  the  relations  between  the  parts,  how  one  part 
becomes  another.    It  pertains  to  the  rules  involved  in  the  changing  nature  o-f 
the  parts.  ^ 

Each  structure  is  al-o  seH-reouU  ^ino,  meaning  that  structures 
inherently  seek  seH  maintenance  and  closure.    No  matter  what  operations  we 
do  on  the  structure  we  still  stay  within  the  system.  Piaget  points  out  that 
no  discussion  o^  structures  would  be  intact  without  a  discussion  o-f  rhythm, 
"regularities  in  the  non-technical  sense  of  the  word  which  depend  upon 
-far  simpler  structural  mechanisms,  on  rhythmic  mechanisms  such  as  perv;3Lde 
biology  and  human  li-fe  at  every  level.  Rhythm  too  is  sel -f-regul at ing,  by 
virtue  o-f  symr.etries  and  repetitions.    Rhythm,  regulation,  and  operation— 
-these  are  the  three  basic  mechanisms  o-f  sel -f-regul  at  ion  and  sel-f- 
maintenance"  (Piaget,  1973). 

The  concept  o-f  whole  nurftbers  tllustrates  well  the  notion  o-f  structure. 
When  we  add  two  w!i>le  numbers  together  we  stay  within  the  system  o-f  whole 
numbers  (sel-f-regulation) .    The  numbers  themselves  have  no  meaning  except  in 
relation  to  each  other  (wholeness);  5  has  no  meaning  except  as  1  more  than  4 
or  1  less  than  <5,  etc.    And,  we  have  many  trans-format ional  rules  explaining 
the  relation  between  the  parts  such  as  adding  2  to  3  gives  5.    Such  rules  are 
reversible  thus  we  know  with  logical  necessity  that  5-3=2.    We  also  have 
rules  dealing  with  associativity  and  comrwut-^ti  v  i  ty,  thus  goals  are  attainable 
by  alternative,  compensatory  routes. 

Contemporary  physics  model-  depict  the  atom  as  a  structure.  Probing 
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into  the  particulate  nature  of  the  atom  has  shown  the  parts  to  be  only 
constructs  oi  the  observer,  dependent  on  the  interaction  with  the  other 
constructs.    Specifically,  the  properties  of  mass  depend  on  the  momentum. 
This  dependency  is  not  unidirectional,  but  compensatory;  momentum  also 
depends  on  the  properties  of  the  mass.    Thus  the  atom  can  only  be  understood 
as  a  continual  dance  of  ensrgy,  a  structural  system  where  the  parts 
interrelate  and  take  on  def ini t i ons  only  in  relation  to  each  other.  Although 
the  parts  are  indissoci abl e ,  transformational  rules  can  be  derived  to  explain 
the  changes  occurring  within  the  atom.    For  example,  these  rules  explain  well 
the  process  of  how  a  photon  becomes  a  wave  and  how  momentum  affects  the  mass 
of  the  particles.    The  rules,  in  fact,  explain  the  self-regulatory  nature  of 
the  atom,  it^  rhythm  and  operations.    As  the  mass  increases  the  momentum  to 
expand  does  also  but  it  is  complemented  by  the  ini^;ard  pull  of  the  mass.  Thus 
the  particles  dance  between  the  poles  of  expansion  and  contraction  to 
maintain  an  optimal  balance,  a  structural  system  of  interwoven  parts  in 
rhythmic  harmony. 

Genesis  of  structures.    Although  Piaget  was  interested  in  illuminating 
cognitive  structures,  he  was  far  more  interested  in  their  genesis.    He  wrote, 
"The  subject  exists  because,  to  put  it  very  briefly,  the  being  of  structures 
consists  in  their  coming  to  be,  that  is,  their  being  ^under 
construction' ...  .There  is  no  structure  apart  from  construction"  (Piaget, 
1970,  pg.  140).    In  essence  he  believed  that  the  human  was  a  developing 
organism,  not  only  in  a  physical,  biological  sense,  biit  also  in  a  cognitive 
sense..    Because  he  viewed  the  organism  as  a  whole  system,  a  structure  <such 
that  emotional  ,  cognitive,  and  physical  development  were  indissociable 
constructs),  he  showed  that  the  mechanism  promoting:  change  in  each  cf  the 
domains  was  the  sa^^e,  that  of  equilibration.    Thus  not  only  was  it 
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equilibration  that  brought  about  the  structural  changes  in  the  snail  in  its 
evolution,  but  it  was  also  the  mechanism  that  explained  cognitive 
development.  In  fact,  it  was  believed,  by  Piaget,  to  be  the  mechanism 
inherent  in  any  transformational,  growth  process. 

He  understood  equilibration  as  a  dynamic  process  of  self-regulated 
behavior  balancing  two  intrinsic  polar  h^haviors,  assimilation  and 
accommodation.    Assimilation  is  the  organization  of  experience  due  to  oner's 
own  logical  structures  or  understandings.    It  is  ihe  indi v idual ''s  self- 
assertive  tendency,  a  tendency  to  view  the  world  through  oner's  own  constructs 
in  order  to  preserve  one^s  autonomy  as  a  part  within  a  whole  system.  Pi^get, 
at  times,  has  called  it  the  "reach  beyond  the  grasp",  the  search  for  new 
knowledge,  new  territory.    The  organism  attempts  to  reconstitute  previous 
behaviors  to  conserve  its  functioning  but  every  behavior  results  in  an 
accommodation  which  is  a  result  of  the  effects  or  pressures  of  the 
environment.  In  other  words,  new  experiences,  "new  territory",  sometimes 
contradict  our  present  understandings  making  them  insufficient,  thus  we 

ommodate.    Accommodation  is  comprised  of  reflective,  integrative  behavior 
which  serves  to  change  one's  own  seH  and  explicate  the  object  in  order  to 
function  with  cognitive  equilibrium  in  relation  to  the  object. 

An  example  of  cooni t ive  eouil ibration.    One  of  the  tasks  used  by  Piaget 
to  demonstrate  equilibration  in  action  utilizes  -even  discs,  piaced  in  a  row 
and  connected  by  chains  to  each  other  so  that  a  comparison  with  discs  other 
than  the  neighboring  ones  is  impossible.    Only  the  last  disc,  G,  can  be 
removed  and  compared  to  each  disc  in  the  series  (see  figure  2).    The  discs 


Place  figure  2  here. 
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increase  in  diameter,  but  only  by  an  imperceptible  amount.    Since  6  can  be 
removed  and  compared  to  all  the  others,  however,  the  perceptual  illusion  o-f 
them  being  all  the  same  size  eventually  becomes  understood  as  an  impossi- 
ibility.    James,  age  7,  approaches  the  task  stating  that  A  is  the  same  as  B; 
B  is  the  same  as  C;  C  is  the  same  as  D;  D  is  the  some  as  Ej  E  is  the  same  as 
F;  and  F  is  the  same  as  G.    When  asked  to  compare  G  to  A,  he  states  that  G  is 
the  big  one  and  all  the  others  are  little  ones.    Then  he  proceeds  to  say  that 
G  is  the  same  as  F,  which  is  the  same  as  E,  which  is  the*  same  as  D,  etc.  The 
contradiction  <G=A,  G  is  larger  than  A)  in  his  logic  is  not  apparent  to  him. 
His  assimilatory  scheme  is  one  o-f  relying  on  perceptual  comparisons  and 
measuring  part,  to  part,  to  part.    Eventually  the  illcgic  o-f  his  prior 
assimilatory  scheme  begins  to  bother  him  and  he  makes  a  -few  minor 
accommodations.    At  -first  he  say<>  that  E,  F,  and     are  the  big  ones  and  A,  B, 
C,  and  D  are  little  ones.    This  accommodation  resolves  th^^  apparent 
contradiction  that  something  cannot  be  big  and  small  at  the  same  time,  and 
thus  serves  as  a  new  assimilatory  scheme;  he  sets  out  to  detorminc  which  are 
the  big  ones  and  which  are  the  small  ones.    A  problem  persists,  however. 
Every  time  he  is  sure  that  he  has  two  groups,  small  ones  and  big.^hes,  he 
measures  the  two  adjacent  <e.g.  D  and  E  in  the  first  attempt)  and  then  thinks 
that  he  made  a  mistake.    Ma.   ?  A,  8,  and  C  are  the  oL^y  little  ones. 
Eventually  he  is  right  back  where  he  started,  with  A  the  only  li.vtle  one; 
The  insufficiency  of  this  assimilatory  scheme  bacon^es  apparent  ai)d  another 
rtccommodation  finally  brings  about  a  stable  structural  chanqe,  one  which 
includes  transitivity.    He  uses  G  to  measure  each  of  the  discs  and  concludes 
that  the  only  possible   >olution  is  that  each  disc  is  slightly  larger  than  the 
one  prior  to  it  and,  th-ii  if  one  were  to  a  id  the  differences  of  A  and  B,  B  ai^d 
C,  t  and  D,  D  and  E,\  E  .and  ,F,  and  F  and  G,  that  amount  would  equal  the  amount 
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that  6  is  bigger  than  A,    The    cognitive  changes  exempi  i-f ied  in  the  thinking 
o-f  James  did  not  occur  in  rapid  succession,  but  instead  were  slow  progressive 
equil ibrations  with  development. 

In  order  to  -fully  understand  equilibration,  one  has  to  think  o-f  it  as  a 
dynamic  process,  not  a  static  equilibrium.    Just  as  matter,  when  viewed  by 
its  particulate  nature,  is  in  a  constant  changing  state  dancing  -from  rrass  to 
waves,  so  too,  the  learner.    Equilibration  is  not  a  linear  happening  o-f  -first 
assimilation,  then  con-flict,  then  accommodation.    Instead  it  is  a  dynamic 
dance  o-f  progressive  equilibrations,  adaptation  and  organization,  gro«/jth  and 
change.    As  we  assert  ourselves  and  our  logical  constructs  on  new  experiences 
and  In-formation  we  exhibit  yang  energ*.    Our  re-flective,  integrative, 
accommodative  nature  is  our  yin  polo.    These  two  poles  provide  a  dynamic 
interplay  which  by  its  own  intrinsic  nature  serves  to  keep  the  system  in  an 
open,  -flexible,  growth-producing  state. 

Constructivism 

De-f  ini  tion.     Philosophically,  constructivists  assert  that  we  can  never 
know  the  world  in  a  "true"  sense,  separate  -from  ourselves  and  our 
experiences,  because  we  are  an  indissociable  part  o-f  the  world  we  are  trying 
to  understand.    We  can  only  know  it  through  our  present  logical  -framework 
which  trans-forms,  organizes^  and  interprets  our  perceptions,  and  this  logic 
is  constructed  and  evolves  through  d'^vel opment  as  we  interact  with  our 
environment  and  try  to  make  sense  o-f  our  experiences.    Facts  and  theories 
which  we  hold  as.  truths  today,  may  be  disproven  tomorrow.  To  constructivists, 
cognitive  development  comes  about  through  the  same  process  as  biological 
development—sel-f-regulation  or  progressive  equilibrations.    We  are,  in  a 
very  real  sense,  "under  construction." 
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Constructivism  in  education.      Under-itanding  learning  as  a  seH- 
regulatory  process,  equilibrating  assimilation  and  accommodation,  suggests 
that  learning  is  an  organic  process  of  construction,  r^xbir  than  a  mechanical 
process  of  accumulation,    m  contrast  to  empiricist/reductionist  approaches, 
learning  -from  a  constructivist  perspective  is  not  seen  as  an  accumulation  of 
facts  and  associations.    Rather,  Piaget  has  conclusive!,,  sha^n  that,  changes 
in  cognition  are  made  throughout  development,  producing  qualitatively 
different  frameworks  of  understanding.    Although  a  maturationist  also 
prescribes  to  such  stages,  he/she  assumes  they  just  unfold  automatically.  A 
constructivist  takes  the  position  that  the  child  must  h?ve  experiences 
hypothesizing  and  predicting,  manipulating  objects,  posing  questions, 
researching  answers,  imagining,  investigating,  and  inventing.    From  this 
perspective,  the  teacher  cannot  ensure  children  get  knowledge  by  dispensing 
it;  a  child-centered  curriculum  and  instructional  mode  is  mandated.  The 
child  must  construct  knowledge.    The  teacher  needs  to  be  a  creative  mediator 
in  this  process. 

Communication  itself  even  shows  eviden.e  of  this  interactive  dance.  A 
polarity  appears  to  exist  betwesin  'istener  and  speaker.    Recent  -film  analyses 
(Leonard,  1981)  shoig  that  every  conversation  involves  a  subtle  and  largely 
unset    dance  in  which  the  detailed  sequence  of  speech  patterns  is  precisely 
synchronized  not  only  with  minuxe  movements  of  the  speaker's  body  but  also 
with  corresponding  movements  by  the  listener.    Both  partners  are  locked  into 
an  intricate  sequence  of  rhythmic  movements.    The  work  of  Brazelton  <1974), 
Tronick  (1975),  and  Stern  (1977),  among  others,  demonstrates  this  same 
"rhythmic  danc'  "  between  baby  and  caregiver. 

From  a  constructivist  perspective,  education  itself  becomes  a  dance— a 
dance  of  interaction  between  learner  and  teacher,  and  learner  and  object. 
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Just  as  mass  cJances  to  become  energy  and  energy,  mass,  so  the  poles  of 
learner  and  teacher  and  learner  and  object  form  paradoxical,  yet  unified, 
relationships  transforming  each  other.    (See  Fosnot,  1984  for  a  delineation 
of  the  principles  involve^l  in  a  constructi vist  approach  to  the.  technology  of 
education.)    The  following  observation  in  a  K-2  classroor.^*  depicts  the  dance. 

The  dance  in  practice.    The  teacher  grouped  several  children  <ages  5  - 
7)  around  her  and  brought  out  a  die  she  had  made.    Each  face  had  a  number  on 
it:  .6,  7,  7,  8,  8,  9.  Thus  one  face  had  a  six;  two  faces  had  sevens;  two 
faces,  eights;  and  one  face,  nine.    With  large  one  inch  graph  p^per,  she  and 
the  children  colored  in  squares  to  represent  *he  faces.    This  process 
resulted  in  a  bar  graph  showing  one  unit  for  six,  two  units  for  7,  two  units 
for  8,  and  one  unit  for  9.    Then  she  placed  the  die  in  a  small  box  and  asked 
the  children  to  guess  what  number  would  show  when  she  spilled  the  die  onto 
the  table.    Around  the  table  they  responded,  each  giring  his/her  own 
reasoning  for  his/her  choice.    Several  children  chose  their  favorite  numbers 
and  said  they  thought  it  would  turn  up  since  it  was  their  favorite.  Others 
guessed  randomly.    T^e  die  was  thrown  and  the  face  was  recorded  on  a  new 
sheet  of  large  one  inch  graph  paper.    Several  trials  ensued,  each  one 
recorded,  and  each  time  chi Idreh  were  asked  for  a  guess  and  their  reasoning. 
Several  children  began  to  guess  7  or  8,  but  their  r«»asoning  was  based  on  the 
fact  ti>at  7  and  S  were  showing  up  more  frequently.    After  several  more  trials 
the  teacher  simply  made  the  obsc^rvation  that  it  was  interesting  that  the 
pattern  showing  up  on  the  graph  was  similar  to  the  one  that  represented  the 
faces  of  the  die.    She  left  the  children  wondering  why  that  was  and  then 
dismissed  them  for  lunch. 

Jed,  a  six  year  old  in  the  group,  looked  bothered  all  through  lunch. 
When  he  returned  to  the  classroom  he  asked  the  teacher  for  the  die  and  began 
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throwing    t  again.    All  of  a  sudden  his  -face  lit  up  and  he  went  running  to 
the  teacher.    "Teacher,  teacher  guess  what  I  just  -figured  out?    I  know  why 
the  sevens  and  eights  kept  coming  up...There^s  two  o-f  each  on  the  die!" 
"Why  does  that  matter?"  queried  the  teacher. 

"Well  you  see  each  time  it  -falls  it  could  land  on  this  side  <top  -face 
with  a  seven)  or  on  this  side  (bottom  -face  with  a  seven).    There's  more 
chances  -for  a  seven  than  a  six  or  a  nine." 

"By  golly,  I  think  you-'ve  got  something  there!"  commented  the.  teacher. 
Then  she  quieted  the  class  so  that  Jed  could  share  his  discovery  with 
evc'ryone . 

Jed  had  constructed  the  beginning  notions  o-f  probability.    Better  put, 
Jed  was  in  the  midst  o-f  "inventing"  probability.    The  teacher  had  -facilitated 
self  regulatory  learning  by  dancing  with  him.    She  had  not  forced  the  notion 
of  p^-obability  on  J^d  by  explaining  the  principle,  externally  motivating  him 
to  learn  it,  and  then  reinforcing  it.    Nor  did  she  jiisi  sit  back  and  wait  for 
it  to  be  constructed  out  of  hjs  play.    Instead^  she  arranged  a  situation 
conducive  to  cognitive  conflict  by  using  a  predict  consequence  approach. 
Further,  ^he  entered  into  the  dance  by  focusing  attention  on  the  simjlar 
patterns  in  the  graphs.    Most  importantly  though,  she  had  provided  di^isonance 
for  cognitive  adaptation,  and  then  respected  his  rhythm,  moved  to  his  tempo, 
and  fostered  his  cognitive  compensations. 

Final  Comments 

The  dance  of  education  is  the  danct  of  growth  and  develop'^'^nt;  it's 
rhythm,  the  heartbeat.     The  interactions  of  learner  and  teacher,  le<irner  and 
object,  form  a  melody  like  notes  playing  off  each  other:  sometimes  in 
'harmony,  sometimes  with  a  Beethovian  discordance  of  creative  tr'isipn. 
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When  a  dance  is  evaluated  it  is  viewed  as  a  whole.    The  dancer  is  not 
assesfied  on  how  well  he/she  can  piroutte,  given  scores  on  each  skill  and  then 
a  total.    He/she  is  evaluated  interacting  with  the  music,  the  other  dancers, 
and  the  audience.    So  too,  perhaps  the  only  way  to  assess  the  child  les'^ning 
IS  to  assess  the  moment}  to  look  at  the  processes  such  as  assimilation  and 
accommodation;  to  study  the  compensations  as  they  occur  in  the  interactions 
between  teacher,  object,  and  learner;  to  value  their  rhythms  and  melodies. 
Assessing  skills  out  o-f  context  of  the  learning  situation  is  like  evaluating 
a  dancer  after  the  performance,  but  net  during  it.    In  the  words  of  the 
physicist,  Capra  (1?82) , 

"There  is  motion  but  there  are,  ultimately,  no  moving  objects;  there  is 

activity  but  there  are  no  actors;  there  are  no  dancers,  there  is  only  the 

dance 
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▲bstrmct 

Two  CAI  programs  tested  the  effect  of  plain  and  enhanced  screen  designs  with 
or  without  information  about  those  designs  and  task^type  on  time  and 
learning.  The  enhanced  versions  used  headings,  directive  cues,  nmning 
heads,  and  graphic  devices  to  organize  and  structure  the  content.  One 
program  required  learners  to  perform  a  memorization  task,  the  second 
required  concept  acquisition  and  concept  application.  The  information 
described  the  purposes  of  the  enhanced  features  and  instructed  the  students 
to  use  those  features  while  studying.  The  plain*-screen  versions  were  equal 
to  the  enhanced  versions  in  learning.  Descriptions  of  text  enhancements 
reduced  lesson  time  when  one  of  the  enhancements  provided  the  learner  with 
program  control  options. 


Introduction 


Problem  Dtsciiption 

The  display  of  instructional  text  is 
not  solely  a  function  of  the  author's 
writing,  but  also  of  the  publisher's 
layout  design  and  selected  medium, 
whether  that  medium  is  paper  or 
electronic  text.  In  both  types  of  me- 
dia, text  format  elements  (see  Table 
1)  are  combined  to  create  "pages" 
and  "screens"  of  information.  In  the 
case  of  print  media,  pages  are  usu- 
ally arbitrary  pcints  for  dividing 
text,  whereas  in  electronic  text, 
screens  serve  as  logical  tmits  of  in- 
formation. The  representation  of  an 
author's  instructional  message  in 
the  selected  medium,  though,  is  not 
where  the  problem  of  design  ends, 
for  instructional  text  has  an  addi- 


tional function.  Instructional  text 
must  encourage  an  interaction  be- 
tween learner  and  text;  it  must  fa- 
cilitate the  cognitive  processes  of 
reading  and  leeaming.  The  primary 
design  problem,  then,  is  to  identify 
those  combinations  of  text  elements 
which  facilitate  specific  learning 
processes. 

Manipulations  of  text  elements  fall 
into  two  general  categories:  efforts 
to  imitate  the  effective  stimulus  and 
efforts  to  facilitate  the  reading  and 
learning  cycles  with  mathemagenic 
devices  or  activities  (for  reviews  of 
this  research  see  Grabinger,  1984; 
Hartley,  1982,  1985,  1987).  Phrase 
chunking,  which  focused  on  making 
the  printed  page,  or  nominal  stimu- 
lus, mirror  the  readers'  perceived 
image  of  the  printed  page,  or  effec- 
tive stimulus,  usually  had  little  ef- 
fect on  reading  speed  or  comprehen- 
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slon  (Carvf r,  1978;  Pynte  and  Noizet, 
1980).  This  lack  of  effect  may  be  due 
to  the  undefined  and  dynamic  na- 
ture of  the  effective  stimulus,  for  it 
is  difficult  to  imiUte  something  that 
cannot  be  seen,  something  that  is  in 
a  constant  state  of  change,  and 
something  that  varies  from  Individ*- 
ual  to  individual.  On  the  other 
hand,  efforts  aimed  at  faciliUting 
the  interactive  processes  of  reading 
and  learning  through  the  use  of 
headings,  questions,  hierarchical 
paragraph  indentation,  and  directive 
cues  sometimes  improved  compre- 
hension when  those  activities  were 
directly  related  to  specific  objectives 
and  when  the  reader  was  aware  of 
their  purposes  (Bausell  and  Jenkins, 
1977;  Prase  and  Schwartz,  1979; 
Hartley,  Bartlett,  and  Branthwaite, 
1980;  Hartley  and  Tnieman,  1982.) 

The  main  conclusions  drawn  from 
these  findings  suggest  that  successful 
design  strategies  are  thcfse  that  re- 
inforce and  facilitate  the  reading  and 
perceptual  cycles.  Though  general- 
izations can  be  reached  about  the 
effective  uses  of  some  specif ic  ele- 
ments in  defined  circumstances,  it  is 
difficult  to  draw  conclusions  about 
combinations  of  the  vast  majority  of 
less  intrusive  text  elements— ele- 
ments that  do  not  overtly  direct  spe- 
cific cognitive  processes. 

Discovering  the  effect  of  combina- 
tions of  elements  is  made  difficult  by 
the  large  number  of  text  elements  in 
operation  at  one  time.  To  simplify 
the  research  problem,  a  way  to  cat- 
egorize those  variables  was  devel- 
oped (Grabinger,  1984,  1987;  Gra- 
binger  and  Amedeo,  1987).  This  clas- 
sification scheme  is  based  on  view- 
ers* Judgments  about  screens. 
Viewers  who  evaluated  model 
screens  composed  of  a  variety  of  text 
elements  preferred  designs  that  ap- 
peai**  organized,  structured,  and/or 
simple*  Organization  refers  to  de- 
signs that  have  clear-cut  segments 
of  text  using  indentation  or  graphic 


organizers  such  as  boxes,  windows, 
or  areas  of  shading  or  color. 
Structure  is  a  more  refined  level  of 
organized  text,  referring  to  text  de- 
signs that  indicate  a  hierarchical 
and  systematic  arrangement  of 
subject  material  utilizing  running 
heads,  headings,  increaf^ed  space 
between  paragraphs  and,  directive 
cues.  Simplicity  refers  to  short, 
concise,  and  spacious  looking 
screens. 

In  other  words,  it  was  discovered 
that  the  design  of  the  page  or  screen 
suggests  something  about  the  content 
of  the  text  on  the  page.  Individual 
text  elements  contribute  to  a 
"whole*  screen  or  page  image  and, 
while  individual  elements  are  per- 
ceived, it  is  the  overall  combination 
that  affects  the  viewer.  The 
viewer,  as  a  result  of  that  overall 
combination,  makes  Jud^ents  about 
the  content  of  the  text.  The  question 
raised,  then,  is  whether  the  graphic 
arrangement  of  the  information  does 
more  than  suggest  something  about 
the  content  of  the  text  such  as,  does 
the  arrangement  effect  how  the 
learner  approaches  the  text,  and  in 
turn,  learning  from  the  text?  An 
answer  to  that  question  may  lead  to 
the  development  of  guidelines  for  de- 
signers of  electronic  text  generally 
and  of  CAI  specifically,  guidelines 
that  may  point  to  relationships  be- 
tween text  design  features  and  the 
activation  of  cognitive  processes  and 
learning  strategies. 

In  an  effort  to  answer  that  question, 
the  aforementioned  constructs  of 
structure,  organization,  and  sim- 
plicity were  used  to  guide  the  design 
of  screens  in  several  versions  of  two 
CAI  programs.  Two  types  of  screens 
were  used:  plain  and  enhanced. 
Plain  screens  suggested  little  about 
the  content  of  the  text  while  the  en- 
hanced screens  presented  structured 
and  organized  displays. 
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In  addition  to  the  screen  layout  two 
other  variables  were  included  in  the 
text  design.  First,  to  vary  the  types 
of  outcomes  expected  from  the  learn- 
srs,  two  types  of  tasks,  memoriza- 
tion and  concept  learning,  were  in- 
cluded in  the  program  designs.  It  is 
also  recommended  that  readers  be 
informed  of  special  textual  design 
devices  and  how  to  tise  them  (Pace, 
198S),  so  descriptions  about  the 
screen  designs  were  included  in 
some  of  the  program  versions. 

It  was  predicted  that  students  who 
used  the  enhanced  screen  versions 
would  Invest  more  mental  effort  in 
studying  the  material.  Therefore, 
students  using  the  enhanced  version 
would  spend  more  time  with  the 
program  and,  as  a  result,  score 
higher  on  both  immediate  and  de- 
layed retention  tests  than  students 
using  the  plain  versions. 


Method 


Subjtcts 


Subjects  were  140  fourth  grade  stu- 
dents from  three  public  schools  in 
Lincoln,  Nebraska.  The  students 
were  predominantly  white,  lower 
and  middle  class  with  71  females 
and  69  males.  All  students  were 
reading  at  least  on  the  fourth  grade 
level  and  had  had  extensive  prior 
experience  with  computers  in  the 
forms  of  CAI,  Logo,  and  keyboard  op- 
eration lessonj.  Participation  was 
voluntary  and  dependent  upon 
parental  permission. 


Program  Conttat 

Two  programs,  Order  and  Orbit, 
were  produced  in  several  versions 
utilising  the  Saber  (1985)  authoring 
system,  an  MS-DOS  based  program. 
Within  each  program,  the  content, 
questions,  and  learning  activities 


were  identical.  The  versions  dif- 
fered in  the  design  of  the  screens 
(see  Figui  e  1)  and  whether  any  pre- 
liminary information  and  instruc- 
tions were  provided. 

Ordar  required  a  memorization 
task  and  taught  the  spelling  of  and 
the  order  of  the  planets  from  the 
Sim.  The  lesson  material  was  di- 
vided into  five  parts:  1)  a  brief  in- 
troduction describing  the  purpose  of 
the  lesson  and,  in  one  of  the  en- 
hanced versions,  a  description  of  the 
purposes  of  the  text  elements  on  the 
screen;  2)  a  pretest  to  test  the 
ability  of  the  students  to  spell  the 
planet  names  correctly  3)  a  brief 
section  to  drill  students  in  the  cor- 
rect spellings  of  the  planets,  if 
spelling  deficiencies  were  found;  4) 
a  section  for  learning  a  mnemonic  to 
help  memorize  the  order  of  the  plan- 
ets from  the  sun;  and  5)  a  test  on 
the  students'  ability  to  list  the  plan- 
ets in  the  proper  order. 

Orbit  taught  the  concepts  of  ellipse 
and  planetary  orbit  and  had  four 
versions.  The  lesson  material  was 
divided  into  four  parts:  1)  a  brief 
introduction  describing  the  purpose 
of  the  lesson  and,  in  the  enhanced 
versions,  the  purpose  of  some  of  the 
text  elements  on  the  screen;  2)  the 
concept  of  ellipse  was  explained  us- 
ing examples,  nonexamples,  and  at- 
tribute isolation  with  text,  graphics 
and,  animation;  3)  .students  were 
tested  on  their  ability  to  identify  el- 
lipses from  among  ether  shapes;  4) 
the  concept  of  ellipse  was  then  used 
to  describe  the  orbits  of  the  planets 
and  to  explain  how  Neptune,  at 
times,  becomes  the  furthest  planet 
from  the  sun;  and  5)  a  test  of 
their  ability  to  apply  the  concepts  to 
the  Neptune/Pluto  phenomenon  com- 
pleted the  program. 

Tht  Dtsign  of  tht  ScrttDs 


O 
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Ovr^n  st^wdarda.    All  screens  (see 
Figure  1  for  models)  were  designed  to 
meet  "recommended  legibility"  stan- 
dards. (Recommended  standards  are 
not  hard  and  fast  rules,  but  flexible 
and  derived  from  research  in  both 
printed  text  and  electronic  text.  The 
most  recent  and  concise  summary  is 
in  Hartley,  1987.)  Lines  of  text  were 
double  spaced,  unjustified,  and  kept 
to  a  maximum  width  of  40  charac- 
ters. Indentation  was  used  to  reflect 
subordinating  ideas.  Responses  were 
alwa>^  made  toward  the  bottom  of 
the  screen.  One  idea  was  used  per 
screen. 

Plain  v>raiona.  The  plain  versions 
include(?.  text,  white  on  black,  with- 
out headings,  directive  cues,  graphic 
organizers,  or  running  heads. 

Enhanc«d  Varalona.  Enhanced 

screens  were  designed  to  appear 
structured  and  organized,  yet  spa- 
cious and  simple.  Each  screen  in  the 
enhanced  versions  included  at  least 
one  heading  describing  the  content  of 
the  page,  a  running  head  at  the  top 
of  the  page  to  describe  the  general 
content  and  task  required  in  the 
section  of  the  program  the  student 
was  in,  and  at  least  one  directive 
cue  in  the  form  of  color  highlighting 
to  emphasize  an  important  word  or 
phrase.  Where  pertinent,  a  graphic 
organizer  in  the  form  of  a  box  (see 
Figure  1)  or  background  color  change 
was  used  to  help  organize  subtopics. 
A  second  running  head  was  added  to 
the  bottom  of  the  screen  in  the  Or- 
bit versions  to  summarize  the 
keystroke  commands  to  move  back 
and  forth  among  the  screens  (this 
second  feature  is  not  seen  in  exam- 
ples in  Figure  l). 

The  Information.     In  Order  3  the 
information  described  the  text  ele- 
ments of  running  head,  heading,  di- 
rective cues,  and  graphic  organizers 
and  explained  why  they  were  used. 
The  instructions  in  the  Orbit  2  and 
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Orbit  4  described  the  text  elements 
and  informed  the  students  how  to 
use  special  keys  to  move  back  and 
forth  between  the  screens  to  review 
material. 

LtssoB  Versions 

Ordsr  had  three  versions  (see  Fig- 
ure 2).  Ordsr  1,  was  a  plain.  Or- 
der 2  and  Order  3  were  enhanced 
with  the  additions  of  a  running 
head,  color,  boxes,  and  lines  to  make 
the  screens  appear  more  organized 
and  structured*  Finally,  instruc- 
tions on  the  meaning  of  the  various 
text  elements  and  how  to  use  them 
to  study  were  included  with  the 
third  version.  Order  3. 

Orbit  had  four  versions.  Orbit  1 
was  plain.  Orbit  2  was  also  plains 
but  included  instructions  on  how  to 
use  specific  command  keys  to  re- 
view previous  screens.  The  screens 
in  Orbit  3  were  enhanced  with  the 
additional  text  elements.    Orbit  4 
included  the  enhanced  screens  and 
added  the  information  about  the 
features  of  the  screen  and  how  to 
return  to  previous  screens  for  re- 
view. 

Orbit  had  four  versions  because  it 
included  the  addition  of  command 
key  descriptions.  Order  had  only 
three  versions  because  a  sophisti- 
cated branching  design  controlled 
student  moves  to  reviews  and  prac- 
tice. 

Measurements 

Three  measurements  were  used  as 
dependent  variables:  average  time- 
per-screen,  immediate  recall  tests, 
and  delayed  retention  tests.  The 
total  time  spent  on  the  program  was 
divided  by  the  total  number  of 
screens  seen  by  the  student  for  the 
time-per*screen  (TimPerScr)  vari- 
able. TimPerScr  was  used  as  an  in- 
dication of  whether  the  added  text 
elements  encouraged  the  student  to 
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spend  more  time  studying,  organiz- 
ing, reflecting,  or  memorizing  the 
subject  material.  The  tests  for  the 
Order  program  were  composed  of  9 
questions  requiring  the  subjects  to 
recall  and  list  the  nine  planets  in 
order  from  the  stm.  The  Orbit 
tests  were  composed  of  five  multiple 
choice  questions  asking  the  subjects 
to  select  ellipses  from  nonexamples 
and  to  test  their  understanding  of 
the  Neptune/Pluto  phenomenon. 


Proctdurcs 

Permission  to  use  the  public  school 
students  limited  the  time  available 
to  an  average  of  20  minutes  per  stu- 
dent. The  programs  were  assigned 
to  students  in  an  ordered  manner  to 
insure  a  balance  of  subjects  for  each 
version.  Students  were  assigned  to 
the  treatment  by  the  cooperating 
teachers  on  a  random  basis.  Stu- 
dents entered  the  treatment  room 
and  sat  before  an  IBM  PC  with  a 
color  monitor.  The  program  was 
then  started.  The  experimenter 
pointed  out  the  "ENTER"  key,  ex- 
plained its  purpose,  and  monitored 
the  progress  of  the  student.  The 
only  assistance  offered  by  the  ex- 
perimenter was  to  help  the  student 
recall  the  proper  key  sequence  to 
proceed  in  the  desired  manner.  No 
assistance  was  provided  with  an- 
swering questions  asked  within  the 
programs.  Following  completion  of 
the  program  the  students  were 
given  a  certificate  of  achievement 
for  participating  in  the  experiment. 
The  delayed  retention  test  (RetTest) 
was  given  two  weeks  later. 

Results 


DtsSgn  and  Analysis 

Since  the  learning  tasks  in  each  pro 
gram  were  different,  each  was  an- 
alyzed separately.  The  analysis  be- 
gan with  a  MANOVA  (SPSSx,  1985)  to 


examine  the  effects  of  the  indepen- 
dent variables  of  program  version, 
school,  and  gender  with  all  three  de- 
pendent variables:  TimPerScr, 
ImTest,  and  RetTest  (see  Figure  2). 
This  was  followed  by  --x  repeated 
measures  ANOVA  (BMDP,  1985)  of 
eiich  program  version  with  the  de- 
pendent variables  of  ImTest  and 
RetTest.  Finally,  when  necessary, 
separate  one-way  ANOVAs  were 
performed  to  help  interpret  the  re- 
peated measures  ANOVA.  A  prede- 
termined significance  level  of  p  <  .05 
was  used. 

Ordtr 

Seventy-eight  students  from  three 
schools.  A,  L,  and  M,  used  the  three 
Ordtr  versions.  The  MANOVA  indi- 
cated a  main  effect  among  schools  - 
(Table  2).  The  foUow-up  univariate 
F-test  indicated  that  School  L  spent 
significantly  more  time-per-screen 
than  either  schools  M  or  A  (Table  3 
and  Figure  3).  The  MANOVA  re- 
ported no  differences  between  gender 
or  among  the  program  versions. 
The  repeated  measures  analysis 
showed  no  difference  for  main  ef- 
fects between  the  ImTest  and 
RetTest  variables  and  the  program 
versions,  but  did  indicate  an  inter- 
action (see  Table  4).  A  one-way 
ANOVA  follow-up  (909  Table  5  and 
Figure  4)  indicated  that  students 
who  used  Ordtr  S  (enhanced 
screens  with  instructions)  scored 
significantly  higher  on  the  delayed 
retention  test  (RetTest)  than  on  the 
immediate  computer  test  (ImTest). 

Reliability  analyses  of  the  9-item 
ImTest  and  RetTest  reported  Cron- 
bach  Alphas  cf  .83  and  .89,  respec- 
tively. 

Orbit 

Sixty-two  students  from  two 
schools,  M  and  A,  used  the  Orbit 
versions.  The  MANOVA  results  re- 
ported no  main  effect  between  the 
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schools,  however  there  was  a  sig- 
nificant difference  among  the  pro- 
gram versions  (see  Table  6)  in  the 
TimPerScr  variable.  The  univariate 
F-test  follow-up  indicated  that  stu- 
dents using  Orbit  3  (enhanced 
screens)  spent  more  time-per-screen 
than  students  using  the  other  three 
versions  (see  Table  7  and  Figure  5). 
There  were  no  differences  between 
gender  or  among  the  program  ver- 
sions within  the  learning  variables 
(ImTest  and  RetTest). 

Reliability  analyses  of  the  5-item 
ImTest  and  RetTest  reported  Cron- 
bach  Alphas  of  .28  and  .53,  respec- 
tively. 


Discussion 


Though  it  was  predicted  that  stu- 
dents would  spend  more  time  with 
the  programs  with  enhanced 
screens,  this  difference  occurred 
only  in  two  situations.  Ui  one  case, 
students  using  Orbit  3  spent  signifi- 
cantly more  time-per-screen  than 
students  using  the  other  Orbit  ver- 
sions. (Orbit  3  included  a  second 
running  head  with  key  command 
summaries,  but  did  not  include  in- 
formation about  the  fMxt  elements.) 
If  the  additional  time-per-screen 
was  due  to  the  text  element  design  it 
would  be  reasonable  to  expect  users 
of  Orbit  4  (identical  to  Orbit  3 
with  the  addition  of  the  text  element 
descriptions)  to  have  spent  a  similar 
amount  of  time-per-screen;  how- 
ever, the  users  of  Orbit  4  spent  the 
same  amount  of  time  as  the  users  of 
the  other  Orbit  versions.  It  is  more 
likely,  then,  that  the  difference  is 
explained  by  the  lack  of  instructions 
and  text  element  descriptions  in  Or- 
bit 3.  The  students  using  Orbit  3 
were  observed  to  have  experimented 
with  the  commands  at  the  bottom  of 
the  screen  to  discover  the  purposes 
of  the  commands.  Students  using 


Orbit  4,  on  the  other  hand,  needed 
no  time  to  experiment  because  the 
purpose  of  each  command  was  ex- 
plained at  the  beginning  of  the  pro- 
gram. This  would  be  consistent 
with  Hartley's  (1987)  recommenda- 
tions that  special  design  features 
should  be  explained  to  readers  in 
advance. 

In  the  second  case,  students  using 
the  Order  program  in  school  L  spent 
more  time-per-screen  than  students 
in  schools  A  and  M.  No  differences 
among  the  schools  were  expected 
since  all  of  the  students  were  read- 
ing on  at  least  the  fourth  grade 
level.  Although  no  ability-level  data 
was  gathered,  subsequent  conversa- 
tions with  teachers  indicated  that 
there  may  have  been  ability  differ- 
ences among  the  schools. 

It  was  also  predicted,  on  the  basis  of 
viewer  preferences  and  classifica- 
tions, that  strv  ctured  screen  designs 
would  provide  powerful  cues  to  fa- 
cilitate mental  involvement  and  thus 
increase  learning  from  the  CAI  ma- 
terial. However,  the  lack  of  in- 
structional effects  attributable  solely 
to  the  arrangement  of  text  elements 
indicates  that  graphic  changes  alone 
fire  not  enough  to  increase  mental 
involvement  with  the  text.  There 
are  several  explanations  which  may 
clarify  why  a  learning  effect  was 
not  found. 

First,  interventions  that  directly  in- 
volve the  learner  have  been  more 
successful  in  affecting  learning.  In  a 
study  comparing  a  mathemagenic 
activity  with  a  text  element  change, 
questions  were  found  superior  to 
highlights  in  aiding  the  learning  of 
factual  Items  and  in  aiding  perfor- 
mance on  higher  cognitive  operations 
(Schloss,  Slndelar,  and  Cartwright, 
1986).  Additional  successful  inter- 
ventions (Davey  and  Kapinus,  1985; 
Glynn,  Britton,  and  Muth,  1985; 
Reder,  Charney,  and  Morgan,  1986; 
Rieber  and  Hannafin,  1987;  Smith 
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and  Friend,  1986)  have  involved  elab- 
orativt,  orienting,  or  generative  ac- 
tivities within  the  structure  of  the 
text,  though  it  is  not  known 
whether  any  special  changes  were 
implemented  on  the  design  of  the  in- 
structional materials.  These 
changes  «re  also  more  mathemagenic 
than  design  changes  to  the  page. 

A  second  explanation  for  the  lack  of 
learning  effect  may  lie  within  the 
individual  differences  of  the  stu- 
dents. It  was  not  possible,  under 
the  restrictions  governing  the  par- 
ticipation of  the  schools,  to  gather 
more  individual  data  about  the  stu- 
dents so,  the  effects  of  ability  was 
not  examined.  In  addition,  all  sub- 
jects were  between  10  and  11  years 
old.  This  may  be  too  young  for  stu- 
dents to  recognize  specific  text  ele- 
ments and  then  develop  strategies  to 
use  those  elements,  for  the  develop- 
ment of  effective  learning  strategies 
is  in  part  related  to  maturation  and 
experience. 

A  third  reason  may  be  found  in  the 
instructional  design  of  the  software. 
The  instructional  design  of  both  p^^o- 
grams  proved  effective,  for  there 
were  no  differences  in  imTest  or 
RetTest  scores  among  the  versions  of 
each  program.  Ordtr  included  a 
mnemonic  in  its  design,  which  is  a 
powerful  learning  strategy  (Carlson, 
Kincaid,  and  Hodgson,  1976).  Orbit 
was  a  highly  visual  program  with 
some  animation,  which  probably 
played  to  a  learning  strength  of 
young  people  (Pavio,  1979). 

Finally,^  the  screens  for  all  versions, 
even  the  plain  versions,  were  de- 
signed to  be  consistent  with  publica- 
tion standards.   There  was  no 
"ringer"  version,  a  version  designed 
so  poorly  that  students  would  have 
had  difficulty  reading  it.  One  of  the 
possible  generalizations,  then,  Is  that 
a  simple,  legible,  clean  design  is  as 
effective  as  the  more  complex  and 
structured  designs. 


There  was  one  result  difficult  to  ex- 
plain. There  appears  to  be  no  ap- 
parent reason  why  Ordtr  S  would 
score  significantly  higher  on  the 
RetTest  than  the  ImTest.  Since  this 
occurred  with  only  one  of  seven 
groups,  the  difference  may  be  the 
result  of  a  small  cell  (24)  or  un- 
known intervening  variables. 

Despite  the  lack  of  instructional  dif- 
ference, there  are  implications  for 
both  screen  design  and  future  re- 
search. .First,  it  appears  that,  for 
this  age  group,  simple,  spacious 
screens  are  as  effective  as  more  or- 
ganized and  structured  designs.  It 
does  not  appear  that  fotarth  graders 
infer  anything  about  the  content 
from  the  arrangement  of  the  text  el- 
ements on  the  screen,  though  the  " 
effects  of  enhanced  designs  on  older 
age  groups  still  needs  to  be  exam- 
ined. Second,  the  addition  of  unex- 
plained text  elements  to  the  screen 
may  prove  distracting.  Although  the 
addition  of  a  command  key  sum- 
mary without  a  description  of  its 
purpose  did  not  interfere  with 
learning  in  this  case,  its  have  a  neg- 
ative affect  on  efficiency.  The  effect 
on  undescribed  text  elements  may 
vary  with  more  complex  material 
and  different  age  groups. 
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Tabu  1 

Examples  of  Text  Format  Elements 


line  length 
type  style 
heading  location 
type  of  directive  cue 
ink  color 

paragraph  indication 
running  head  location 
Justification 
character  attributes:* 

reverse  video 

underlining 

lUlics 

line  breaks 

page  numbering 


type  size 
leading 

use  of  directive  cues 

number  of  columns 

paper  color 

use  of  graphic  devices 

use  of  headings 

word  spacing 

functional  areas:** 
running  heads 
directions 
student  responses 
error  messages 
feedback  to  students 


(•Isaacs,  1987;  *«Heined,  1984) 
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MANOVA  Results  of  Difftrtncts  Among  Schools  for  Ordtr 

Iiat  VAlm        Approx.  P       Hvwth.  DP    Error  DP  M-. 

Plllals  .29611  3.18611  7540.19690        110.0  .006 


Univuriatt  P-Ust;  Difftrtnces  Among  Schools  for  Ord«r 


Variable 

SS 

Error  SS 

HvDOth.  MS 

Error  MS 

P  Slf . 

TlmPtrScr 

.06757 

.3626^1 

.03378 

.00648 

5.21704 

.008 

ImTtst 

37.72113 

373.81905 

18.86056 

6.67534 

2.82541 

.068 

RttTcst 

36.26461 

451.70079 

18.14231 

8.06609 

2.24921 

.115 

TabU  4 

Rcptattd  Measures  ANOVA  for  Ordtr  Program 


Source 

Sum  of 
Sauares 

Degrees  of 
Preedom 

Mean 
Sauare 

P 

Tall 
Prob. 

Mean 

7340.19690 

7340.19690 

750.18 

.0000 

Order 

2.86386 

1.43193 

.15 

.8641 

Error 

694.70370 

71 

9.78456 

Main  Effect 

3.82017 

3.82017 

.83 

.3654 

2-Way  Inter. 

32.42773 

16.21387 

3.52 

.0348  * 

Error 

326.86957 

71 

4.60380 
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Tablt  S 

PoUcw-up  ANOVA  of  Inttraction  Identified  in  Order  Projrani 


Source 

Sum  of 
Squares 

Degrees  of 

Prctfdom 

Mean 
Square 

P 

Tail 
Prob. 

Mean 

2523.00000 

I 

2523.00000 

300.o7 

.0000 

Error 

193.00000 

2S 

8.39130 

.15 

.8641 

Main  Effect 

21.33333 

1 

.33533 

5.94 

.0230 

Error 

82.^7 

23 

3.59420 

Tabla  « 

MANOVA  Results  of  Differences  Among  Orbit  Versions 

Test 

Value 

Aporox.  P 

HvPoth.  DP 

Error  DP 

,si|- 

Pillais 

.57965 

3.51250 

9.00 

132.00 

.001 

TaUt  7 

Univariate  F-lest:  Differences  Among  Orbit  Versions 


Variable    Kvpoth.  SS 

Error  SS 

Hvpoth.  MS 

Error  MS 

P 

Sig. 

TimPerScr  .29900 

.36767 

.09967 

.00836 

11.92746 

.000 

ImTest  3.91677 

92.38214 

1.30559 

2.09959 

.62183 

.605 

RetTest  4.27161 

29.64762 

1.42387 

.67381 

2.11316 

.112 
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Flfure  1 

Examples  of  Screens  from  the  CAI  Programs 

la.  'Plain  VaniUa^  Screen 
f 

XXXXXXXXXXICXKXXXXXXXICICX^^ 
XmKXXKXIOCIOCIClCXXXXX^ 

xxxxxxxwcxxxxxxxxxxxxxxxxxxx^ 
xxxxxxxxxxxxxxxxxxw 

HXXXXXXXIOOCXXXXXXXXIOCXXIOCXX^^ 
XXXSOOCMXXXXXICICXXMXXIOCSOOO^^ 

KXMtXXICXXXXXXXXXXXXXXXXXXX)^^ 
XXXXXXXXXXXXXXXXXXXIOOOO 


lb.  Enhanced  Screen 


xxxaoooocxxxxxxxxxxxxxxxxiocx^ 
NMSciaacxioaaootifMifi^^ 

XIOPOOOPOOOOOOOOOOO 


lOOOOOOCIOOOQOOIXIOCXXIOCKHIO^^ 

II  il  II M  li  il » II  ii  liM^Mil  H  li  II  il  il  H  W  H 11 II H  H  H  H  » 
XXXXXXXXIOOCXXXXXIOCXIOCXIOCX^^ 

XIOOCXXXXXXXXXXXXXXXXXM 
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Pigur*  2 

Diagram  of  Research  Analysis 

Order  1  Order  2  Order  3 

Imtest 
Rettest 

Timeperscr 

Orbit  1  0rD1t2  OitltS  Ort1t4 

Imtest 
Rettest 
Timeperscr 

Figure  3 

Observed  Means  Among  Schools  For  TimPer^r 


Schools 
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Figure  4 

Interaction  Program  Version  and  Time  of  Test  for  Ordtr 


Qrd*r  1  Qrd*r  2  Qrd*r  3 

Program  Vorslon 
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Independent  Study: 
Personality,  Cognitive,  and  Descriptive  Predictors 


Abstract 


This  study  compared  personality^  cognitive  style,  and  descriptive  prefer- 
ences of  79  preservlce  undergraduate  education  students  who  chose  Inde- 
pendent study  vs.  traditional,  teacher-directed  study.  Self-esteem,  field- 
articulation,  locus  of  control,  cognitive  style  preference,  and  need  for 
achievement  tests  were  administered  and  descriptive  data  regarding  GPA, 
gender,  and  educational  mz^or  were  collected.  A  discriminant  analysis  of 
test  scores  Indicated  that  those  electing  Independent  study  had  a  high  need 
for  achievement,  had  an  internal  locus  of  control,  and  preferred  learning 
via  active  experimentation.  


Introduction 

Independent  study  Instructional 
designs  have  been  popular  over 
the  past  two  decades.  Popular 
forms  of  self-paced  designs  In- 
clude learning  centers,  pro- 
grammed Instruction,  and  the 
personalized  system  of  Instruction 
(PSD.  PSI,  or  Keller  Plan,  courses 
provide  self-paced  learning 
through  a  structured  set  of 
learning  experiences  Including 
quizzes,  readings,  media  materi- 
als, assignments,  and  proctorlng. 
Learners  are  responsible  for 
scheduling  their  time  and  com- 
pleting the  exercises.  Independent 
study  systems  assume  that 
learners  will  complete  instruction 
mor  e  efficiently  and  with  greater 
satisfaction  because  they  control 
the  paje  of  Instruction  and  select 
from  a  variety  of  instructional 
materials  options  designed  to 
accommodate  individual  differ- 
ences. 

Courses  that  utilize  PSI  assume 
that  self-paced  Instruction  is  good 
for  everyone.  Yet,  many  Inde- 
pendent study  programs  have 
failed  because  course  designers 
did  not  consider  that  personalities 


and  learning  styles  of  the  learn- 
ers were  not  consistent  with  In- 
dependent study.  The  demands  of 
self-regulation  (pacing,  sequenc- 
ing, and  practice  of  Instructional 
activities)  are  a  radical  departure 
from  traditional  teacher  con- 
trolled classes  and  cause  signifi- 
cant anxiety  in  learners.  The  In- 
stitution of  a  PSI  course  in  In- 
structional technology  at  the  Uni- 
versity of  Nebraska  at  Lincoln 
has  met  with  a  high  level  of  dis- 
satisfaction. Although  a  few  stu- 
dents seem  to  thrive  In  the  pro- 
gram and  most  passed  the  course 
with  "A's"  and  -B's%  closing 
course  evaluations  Indicate  that 
most  were  frustrated  and  suf- 
fered a  great  deal  of  anxiety 
through  the  experience.  A  previ- 
ous study  by  Jonassen  (1985),  ini- 
tiated under  similar  circum- 
stances, suggested  that  such 
problems  may  be  due  to  learner 
characteristics.  Jonassen  investi- 
gated field  articulation,  cognitive 
style,  self  esteem,  and  achieve- 
ment factors  and  found  that  stu- 
dents choosing  the  PSI  method 
were  field  Independent,  had  an 
Internal  locus  of  control,  were 
less  Influenced  by  others,  and 
employed  more  flexible  reasoning 
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patterns. 

It  was  observed  in  the  University 
of  Nebraska  program  that  there 
seemed  to  be  other  factors  corre- 
lated to  the  decision  to  follow  PSI 
or  traditional  coursework,  when 
given  the  choice.  Most  students 
electing  the  PSI  option  were  fe- 
male, secondary  education  stu- 
dents with  what  appeared  to  be 
above  average  ability.  The  intent 
of  this  study,  then,  was  to  ex- 
amine the  relationship  among 
cognitive  styles,  personality  char- 
acteristics, and  descriptive  charr 
acteristics  of  students  who  elected 
the  PSI  mode  vs.  those  who  chose 
the  teacher-directed  mode. 


Method 

One  hundred  thirty  nine  under- 
graduate students  enrolled  in  an 
introductory  instructional  tech- 
nology course  at  the  University  of 
Nebraska  at  Lincoln  made  up  the 
sample  for  the  study.  The  stu- 
dents were  secondary  or  ele- 
mentary education  majors  and 
predominantly  female  (over  60%). 
During  the  initial  class  session, 
students  were  administered  a  se- 
lection fo  personality  and  cogni- 
tive style  instruments  listed  be- 
low. Complete  data  were  com- 
piled for  only  79  students,  so  this 
group  comprised  the  sample. 
Instrumentation 

JiosenJberg's  SeJf-Esteem  Sca/ei 
Rosenberg,  1965),  is  a  self-report, 
10-item,  forced-choice  scale  de- 
signed to  assess  global  self-es- 
teem. The  lower  the  score,  the 
higher  an  individual  rates 
him/herself. 

Rotter's  InternahExternal  Scale 
(Rotter,  1966)  is  a  29-item  (six 
fillers),  forced-choice  test  which 
assesses  degree  of  internality  of 


externality.  Larger  scores  repre- 
sent higher  levels  of  externality. 

Group  Ein bedded  Figures  Test 
(Oltman,  Raskin,  and  Witkin, 
1971)  is  a  32-itern  test  to  measure 
field  articulation.  It  was  designed 
to  test  an  individual's  ability  to 
locate  a  previously  seen  simple 
figure  within  a  larger  complex 
figure  which  has  been  so  orga- 
nized as  to  obscure  or  embed  the 
sought-after  simple  figure.  The 
larger  the  score,  the  more  able 
the  student  is  to  disembed  the 
figure  and  thus,  the  more  field 
independent  or  analytical  the  stu- 
dent is. 

KoJJb  Learning  Style  Inventory 
(Kolb,  1983)  is  a  12-item  test 
which  assesses  a  respondent's 
preferred  style  of  learning.  Four 
scores  are  generated  to  assess  the 
degree  to  which  each  student 
prefers  to  learn  via  concrete  ex- 
perience (CE),  abstract  conceptu- 
alization (AC),  active  experimen- 
tation (A£),  and  reflective  obser- 
vation (RO). 

Conceptual  Styles  Inventory 
(Kagen,  Moss,  and  Siegel,  1963)  is  a 
30-item,  graphic  test  to  measure 
a  respondent's  predilection  to 
think  in  a  relational  or  analytical 
manner.  Only  Part  1  (15  items) 
was  used. 

Need  for  Achievement  Scale 
(Samuels,  1979)  is  a  24-item 
forced  choice  test  to  measure  need 
for  achievement.  Higher  scores 
indicate  a  greater  motive  to 
achieve. 

Descriptive  Information  was  col- 
lected on  individual  data  sheets. 
Information  collected  included 
GPA,  gender,  and  major. 

A  Course  /detest  was  adminis- 
tered. The  pretest  scores  were 
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used  to  determine  whether  prior 
knowledge  affected  the  decision  tb 
choose  PSI  or  classroom  instruc- 
tion. 

PSI  Risistntiott  /&rmwas  used  to 
record  each  students  reason  for 
selecting  for  the  PSI  method  of 
study. 


and  completed  the  course  in  the 
independent  study  format.  Stu- 
dents' reasons  for  choosing  one 
format  over  the  other  were  not 
considered,  only  their  desire  to 
participate. 


Results 


Procedure 

Following  testing,  the  require- 
ments of  the  course  were  ex- 
plained. Students  were  given  the 
choice  of  completing  the  course 
requirements  by  PSI  or  tradi- 
tional classroom,  teacher-paced 
instruction.  The  former  consisted 
of  using  manuals,  quizzes,  and 
media  materials  for  each  topic  in 
a  specified  sequence.  The  latter 
method  consisted  of  regularly 
scheduled  class  sessions  consisting 
of  lecture,  demonstration,  discus- 
sion, and  viewing  and  listening  of 
audiovisual  materials.  Course 
requirements  and  standards  were 
identical  for  each  group.  Follow- 
ing the  choice  of  study  formats, 
each  group  was  provided  with  in- 
structions specific  to  their  mode 
of  study  and  dismissed. 

Of  the  original  139,  79  (82J5)  fin- 
ished all  materials  and  the 
course.  Of  the  79,  17  (22J5)  chose 


A  stepwise  discriminant  analysis 
of  14  variables  was  conducted, 
using  Wilk's  Lamda  and  a  F  >  1.0 
as  entry  criterion.  A  total  of 
68.35X  of  the  grouped  cases  were 
correctly  classified  by  the  analy- 
sis. Three  significant  discrimi- 
nant variables  emerged  (Table  1). 
The  most  significant  discrimina- 
tor was  need  for  achievement. 
Independent  study  students  had  a 
higher  achievement  motive. 
Closely  related  was  the  next  most 
significant  variable,  locus  of  con-- 
trol,  where  independent  study 
subjects  were  more  internal  and 
preferred  to  take  more  personal 
control  of  their  own  learning. 
The  third  significant  variable 
was  the  active  experimentation 
(AE)  dimension  of  Kolb's  learning 
styles,  where  the  learning 
strengths  of  the  independent 
study  students  lay  in  their  desire 
to  do  things,  to  carry  out  plans 
and  experiments,  to  apply  new 
ideas. 


Table  1.   Stepwise  Discrimination  Analysis  Besults 


Cumulative 

Variable 

P 

Wilk's  Lamda 

(1)  Need  for  achievement 

11.190 

.87307 

(2)  Locus  of  control 

3.980 

.95085 

(3)  Active  experimentation 

2.972 

.96284 

305 

308 


Page  5 


Discussion 

The  analysis  supports  the  con- 
tention of  Szabo  and  Feldhusen 
(1970)  that  personality  variables, 
are  useful  as  predictors  of  inde- 
pendent study  preference.  These 
results  and  those  from  Jonassen*s 
(1985)  study  have  identified  sev- 
eral basic  characteristics  that 
may  serve  as  discriminators 
between  students  choosing  inde- 
pendent study  and  those  choosing 
a  teacher-directed  class.  In  both 
studies,  locus  of  control  v/as 
found  to  be  a  significant  dis- 
criminator. The  independent 
study  students  possess  a  high  in- 
ternal locus  of  control,  that  is, 
they  choose  to  be  responsible  for 
their  own  actions  and  attribute 
successes  and  failures  to  their 
own  ability  and  effort.  Both 
studies  also  show  that  these  stu- 
dents have  a  higher  need  for 
achievement,  that  is,  independent 
study  students  have  a  high  mo- 
tive to  succeed  and  work  dili- 
gently to  attain  their  goals.  The 
••locus  of  control"  and  •'need  for 
achievement"  discriminators  cor- 
relate closely  with  Jonassen^s 
(1985)  addition  findings  that  inde- 
pendent study  students  were 
more  self-confident  and  had  a 
lower  need  for  affiliation. 

There  was  no  evidence  to  suggest 
that  ability  or  descriptive  factors 
played  roles  in  influencing  the  in- 
dependent study  decision.  Neither 
GPA  nor  other  intelligence  vari- 
ables (Jonassen,  1985)  were  sig- 
nificant descriptors.  Nor  were 
gender,  major,  and  prior  knowl- 
edge correlated  with  the  decision. 

So,  a  clear  conception  of  students 
who  select  independent  study  has 
been  confirmed.  These  students 
are  goal-oriented,  more  purposive 
in  achieving  their  goals,  and  less 
influenced  by  peer  values  and 
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motives.  These  students  are  self- 
reflective,  Independent,  and  self- 
assured.  They  are  willing  to  take 
moderate  risks,  especially  if  the 
risks  permit  them  to  maintain 
active  control  of  their  learning 
activities.  They  believe  in  their 
own  ability.  These  interpreta- 
tions are  also  supported  by  the 
independent  study  students*  own 
statements,  for  59X  (12  of  17)  of 
those  who  elected  PSI  state  that 
they  wished  to  take  more  respon- 
sibility and  have  more  control 
over  their  won  learning.  (The 
other  five  students  stated  that  a 
scheduling  conflict  was  the  pri- 
mary reason  for  opting  for  PSI.) 

The  implications  of  these  findings 
are  that  independent  study, 
within  a  standard  PSI  course 
structure,  is  a  preferred  mode  of 
instruction  for  only  a  minority  of 
students  who  are  strongly  moti- 
vated and  self-assured.  To  force 
other  students  into  a  PSI  course 
causes  increased  anxiety  and  in- 
creased levels  of  anxiety  can  im- 
pede learning.  The  inference  is 
clear.  The  best  way  to  individu- 
alize instruction  may  not  be  to 
force  all  students  into  a  classi- 
cally structured  PSI  course.  To 
do  so  is  to  ignore  their  their  per- 
sonality and  learning  styles. 
Different  kinds  of  support  struc- 
tures need  to  be  developed  and 
tested  for  those  who  have  lower 
achievement  and  internal  control 
levels.  Additional  research  should 
also  examine  the  effects  of  prior 
experience  with  independent 
study  and  training  in  using  inde- 
pendent study  programs.  Indi- 
vidualization that  does  not  ac- 
commodate to  the  personality 
needs  of  the  learners  is  not  truly 
individualized. 
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Internally  Generated  Feedback 
with  an  Instructional  Expert  System 


Background 

The  provision  of  fctdback  is  a  major  part  of  instruction.  This  is  especially 
important  in  a  procedural  Usk,  such  as  the  production  of  instructional  ma- 
terials, where  students  learn  and  practice  new  skills  with  unknown  expec- 
tations. Appropriate  feedback  confirms  the  learner's  expectancy,  directs  at- 
tention to  relevant  factors,  and  stimulates  recall  of  relevant  skills  and 
knowledge  (Game,  1977).  Generally,  reseai  ^  indicates  that  "appropriate 
feedback"  is  precise,  frequent,  and  most  valuable  immediately  following 
cempleUon  of  a  task  (Van  Houten,  1980).  However,  the  feedback  process  is 
ofUn  higl  /  dependent  upon  the  quaUty  of  the  teacher  administering  the 
instructional  system. 

The  impetus  for  this  study  arose  from  the  heed  to  provide  timely  and  spe- 
cific feedback  about  the  quality  of  a  variety  of  visual  materials  production 
techniques  (dry  mounting,  laminating,  rubber  cement  mounting,  lettering, 
and  cutting).  The  provision  of  appropriate  feedback  was  a  persistent  prob- 
lem because  minimally  qualified  teaching  assisUnts  (TAs)  were  used  to  staff 
the  cUfts  ).ab  sessions.  The  TAs  main  weaknesses  were  in  the  areas  of 
consistency,  accuracy,  and  knowledge  of  production  techniques.  Students 
frequently  had  to  wait  long  periods  for  advice  on  the  quality  of  their  skills 
and  projects.  There  was  also  a  long  gap  between  completion  of  a  project 
and  its  evaluation  report.  While  the  learning  of  procedural  skills  was  for 
the  most  part  successful,  there  were  wide  differences  in  quality  and  the 
ability  of  the  students  to  evaluate  their  own  or  others  application  of  the 
skills... 

The  purpose,  then,  of  this  study  was  to  develop  an  instructional  system 
that  would  provide  precise  and  timely  feedback.  More  specifically,  the  ob- 
JecUves  of  this  project  included  both  basic  and  applied  concerns:  first,  was 
the  need  for  a  teaching  strategy  that  would  facilitate  the  learning  of  pro- 
duction skills  and  their  subsequent  transfer  to  an  evaluation  and  self-cri- 
tiquing task;  and  second,  was  the  need  to  develop  an  instructional  system 
that  wmild  efficiently  and  effectively  teach  a  large  number  of  undergradu- 
ates with  minimally  qualified  Uaching  assistants. 

The  proposed  solution  called  for  an  expert  system  as  a  central  part  of  a 
complete  instructional  system.  An  expert  system  seemed  a  creative  and 
effective  because  of  the  Ukelihood  of  a  change  in  student  processing  strate- 
gies. It  was  believed  that  the  expert  system  would  enable  the  students  to 
use  processing  strategies  not  used  when  receiving  feedback  from  lAs.  The 
TAs,  who  facilitated  learning  by  offering  suggestions  and  brief  critiques  of 
student  techniques,  did  not  foster  the  growth  of  a  schemata  appropriate  for 
learning  to  evaluate  productions  because  their  method  did  not  illuminate 
nor  involve  the  student  in  using  the  evaluation  criteria.  The  expert  sys- 
tem, on  the  other  hand,  offered  a  method  that  would  illuminate  the  pro- 
duction criteria  by  taking  learners  through  questions,  choices  and  decisions 
in  a  step-by-step  manner.  It  was  expected  that  the  expert  system  would 
permit  the  acUve  manipulation  of  variables  (production  criteria)  while 
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testing  the  tffircts  of  hypotheses  (production  practices)  would  affect  learning 
(Salomon,  1985).  SrJomon  (1985)  sUted  that 

"The  more  «  technique  can  be  desigi\ed  to  activate,  model,  or 
short-H^lrcult  cognitions  hitherto  untapptd  by  other  me&ns, 
the  greatc  its  opportunity  for  fost.^rlng  unique  learning  ef- 
fects and  f.:.  making  a  difference  in  icMming  and  develop- 
ment." (p.  210) 

In  this  case,  the  expert  system  embedded  strategies  in  the  instructional  pre- 
sentation that  would  encourage  the  learner  to  process  the  information  in  a 
systemaUc  and  precise  way  In  order  to  work  through  the  material  (Rlgney, 
1978).  In  other  words,  the  expert  system  fostered  a  more  "mindful" 
(Salomon,  1985)  approach  to  instruction  on  the  part  of  the  learner  by  di- 
recting attention  and  encouraging  a  more  mentally  active  role  in  evaluating 
their  own  projeete.  The  expert  syj^tem  also  moved  the  focus  of  i.'«dback 
provision  from  external  to  internal.  The  studente,  in  a  sense,  generated 
their  own  feedback  rather  than  having  it  provideci  externally  from  the 
teaching  assistant.  HUIman  (1970)  showed  that  a  group  receiving  immediate 
feedback  through  self-scoring  showed  considerably  more  Improvement  on  a 
stendard  test  than  the  group  receiving  24-hour  feedback. 

The  proposal  to  use  an  expert  system  under  such  condlUons  raised  several 
questions.  First,  could  an  expert  system  provide  feedback  as  effectively  as 
a  "skilled"  instructor?  Second,  how  would  the  use  of  an  expert  system  af- 
fect the  learning  of  procedural  obJecUves?  Third,  how  would  the  use  of  an 
expert  system  affect  the  learning  of  the  abiUty  to  apply  the  producUon 
sklUs  to  an  evaluaUon  Usk?  Finally,  what  would  be  the  reacUons  and 
opinions  of  studente  using  a  "machine"  for  feedback?  The  foUowing  hy- 
potheses were  formed  to  guide  the  study: 

1.  The  learning  and  application  of  procedural  production  skills  would  be 
equal  between  a  group  using  the  expert  system  for  feedback  and  a 
group  receiving  teacher  provided  feedback.  No  difference  in  procedural 
skUls  was  expected,  despite  the  feedUck  system  because  both  groups 
would  be  instrucbd  by  the  same  teacher  in  the  same  manner  and 
complete  the  same  assignmente.  Clark  (2984,  1985)  and  Hagler  and 
Knowlton  (1987)  emphasized  that  if  the  message  is  the  same  the  learn- 
ing will  be  the  same. 

2.  A  group  using  an  expert  system  for  feedback  would  provide  more  de- 
Uiled  evaluations  of  new  projecte  than  a  group  receiving  teacher  feed- 
back. The  coiitentlon  is  that  studente  using  an  expert  system  would 
receive  feedb&ck,  but  would  uUlize  different  processing  strategies.  If 
different  processing  strategies  are  used,  then  it  is  likely  that  different 
learning  will  result.  It  seemed  Ukely  that  the  ex^t  system  users 
would  learn  more  of  the  details  about  the  criteria  used  to  evaluate  the 
projecte  since  they  would  be  forced  to  work  through  the  criterial  In 
deteil  and  this  difference  would  show  up  on  an  evaluation  tesk. 

3.  Expert  system  users  would  have  a  positive  attitude  about  using  the 
system.  Several  studies  (Hess  and  Tenezakls,  1973;  Schurdak,  1967;  and 
Schwarte  and  Long,  1967)  have  found  that  CAI  is  frequenUy  preferred 
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]3y  learners,  therefore  it  seemed  reasonable  to  expect  that  the  students 
would  have  positive  opinions  regarding  the  use  of  the  expert  system. 


Method 

Subjects: 

Subjects  were  43  undergraduate  students  from  a  basic  instructional  mate- 
rials production  class  that  was  a  requirement  in  the  teacher  preparation 
program.  Ages  ranged  from  20  to  40  years  of  age.  There  were  25  women 
and  18  men. 

Trcatrngnt  firoupa: 

Two  treatment  groups  were  used:  one  group  generated  itgs  own  feedback 
by  using  an  expert  system  and  the  other  group  received  feedback  from  a 
teacher. 

Procedures: 

The  subjects,  though  from  one  class,  belonged  to  two  different  labs:  a 
morning  lab  and  an  afternoon  lab.  To  minimize  confounding  (Kuiik,  Kulik, 
and  Cohen,  1980;  Clark,  1985;  and  Hagler  and  Knowlton,  1987)  both  groups  re- 
ceived the  same  instruction  at  the  same  time  from  the  same  teacher. 

After  attending  the  morning  lecture,  the  first  lab  group  went  directly  to  a 
lab  session  while  the  afternoon  lab  left  and  returned  at  their  appointed 
time.  The  treatments  were  assigned  to  the  lab  sections:  the  morning  lab 
received  the  expert  system  feedback  treatment  and  the  afternoon  lab  re- 
ceived the  human  feedback  treatment.  Each  student  performed  five  pro- 
duction tasks:  dry  mounting,  laminating,  rubber  cement  mounting,  letter- 
ing, and  cutting. 

Labs  were  used  as  practice  and  production  time.  For  both  groups,  the  only 
assistance  given  by  the  instructor  was  in  cases  of  correcting  improper  or 
unsafe  techniques.  When  the  expert  system  group  had  questions  refi;arding 
the  quality  of  a  particular  technique  or  project,  they  were  required  to  use 
the  expert  system  for  advise.  When  the  teacher-provided  feedback  group 
had  questions  regarding  the  quality  of  their  work  they  were  answered  by 
the  teacher. 

One  week  following  completion  of  the  production  tasks  they  evaluated  a 
new  sample  of  each  production  task.  The  evaluation  task  took  the  form  of 
a  written  essay  whereupon  the  student  wrote  as  much  as  they  chose  about 
the  strengths  and  weaknesses  of  each  of  five  project  samples. 

Expert  System  Materials: 

The  expert  system  was  created  with  an  a  shell.  Expert  Ease  (Human  Per- 
formance Technolgy,  1984)  and  used  a  question  and  answer  approach.  Stu- 
dents had  to  read  the  questions,  analyze  their  work,  make  an  evaluative 
Judgment,  and  enter  responses  to  work  through  the  program.  The  ques- 

315 


tion/re3ponse  technique  was  used  because  questions  that  require  learners  to 
relate  textual  information  to  what  they  already  know,  to  interpret  and  in- 
fer, make  the  textual  material  more  meaningful  and  mere  memorable 
(Lindner  and  Rickards,  1985).  There  was  a  separate  section  within  the  ex- 
pert system  for  each  production  project.  Each  section  was  composed  of  a 
series  of  questions  based  on  the  criteria  (see  Figure  1  for  a  summary  of  the 
criteria  for  each  project)  used  to  evaluate  each  project  (see  Figure  2  for  two 
screen  samples  from  the  expert  system  program).  At  the  end  of  each  crite- 
rion the  student  was  asked  to  Judge  whether  the  project  .was  satisfactory 
or  unsatisfactory  with  respect  to  that  criterion. 

Testing  *nd  Measurements; 

Each  of  the  five  production  projects  were  evaluated  on  a  five  point  scale. 
Evaluators  used  a  checklist  comprised  of  the  standard  criteria  for  each 
project.  The  evaluation  task  was  subjected  to  two  measurements.  Within 
each  of  the  five  written  project  evaluations  content  analysis  was  used  to 
count  the  number  of  standard  criteria  cited  and  of  the  number  of  new  cri- 
teria applied  or  generated.  Opinion  measurements  included  a  self-rating  of 
learning,  a  rating  of  the  expert  system. 


Results 


Table  1  reports  the  results  of  the  quality  of  the  production  projects  when 
compared  using  a  two-tailed  t-test  (Chase,  1976).  Each  project  was  evalu- 
ated on  a  10  point  scale  (10  was  excellent).  Although  each  project  mean  for 
the  internally  generated  feedback  group  was  higher  than  the  corresponding 
project  mean  for  the  externally  provided  feedback  group,  the  differences 
were  not  significant  (p  <  .05). 

Table  2  reports  the  t-test  results  for  the  number  of  details  that  the  partici- 
pants cited  from  the  standard  criteria  in  their  written  evaluations  of  sam- 
ple projects  in  the  evaluation  task.  The  only  significant  difference  (p  <  .05) 
in  the  ability  of  the  two  groups  to  evaluate  a  project  was  in  the  evaluation 
of  lettering  samples.  The  Internally  generated  feedback  group  (2.9333)  cited 
significantly  more  details  than  the  group  receiving  external  feedback 
(2.5455). 


The  second  measure  of  the  evaluation  task,  the  number  of  non-standard 
criteria  generated,  showed  a  significant  effect  (p  <  .05)  for  the  internally 
generated  feedback  group  (see  Table  3).  The  internal  feedback  group  gener- 
ated an  average  of  1.6  new  items  for  all  five  evaluation  tasks,  while  the 
externally  provided  feedback  group  provided  generated  an  average  of  1.3 
new  details. 
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Overall,  the  opinion  measurements  of  the  students  who  used  ihi  expert 
system  to  generate  their  own  feedback  about  their  projects  were  favorable. 
Table  4  shows  that  the  stud«»nts  believed  that  the  knowledge  they  gained 
was  essentially  the  same  as  the  externally  provided  feedback,  group.  They 
also  believed  that  the  use  of  the  expert  system  neither  improved  nor  hurt 
their  project  evaluation  scores.  Table  5  presents  the  summary  of  results 
for  overall  reaction  to  using  the  expert  system  to  generate  feedback  about 
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their  projects.  Two**thirds  of  the  reactions  were  at  level  six  or  above  on 
the  10-point  scale  (10  was  positive). 


Discussion 

As  predicted,  both  instructional  methods  were  equally  effective  in  the 
teaching  of  the  procedural  skills  used  for  producing  the  projects.  This  re- 
sult is  consistent  with  Clark's  (1984)  statements  that  learning  comes  from 
effective  instructional  deisign  ~  not  from  the  medium  used  to  deliver  the 
instruction.  Note,  though,  in  Table  1,  all  of  the  project  evaluation  means  of 
the  internally  generated  feedback  group  are  higher  than  the  externally  pro- 
vided feedback  group.  Is  this  trend  due  to  the  novelty  effect?  Probably  not 
because  the  use  of  computers  for  instruction  was  not  new  to  the  class*  Did 
the  students  who  used  the  expert  system  try  harder?  Again,  probably  not, 
because  this  was  the  first  unit  in  the  first  week  of  a  new  session  —  a  time 
when  most  students  are  motivated  and  ready  to  begin  anew*  The  trend 
may  be  due  to  the  positive  and  specific  nature  of  the  questions  uked  by  the 
expert  system*  The  expert  system  provided  information  related  to  both 
successes  and  failures,  while  the  lab  assistant  usually  concentrated  on  fail- 
ures of  production  technique*  The  expert  system  provided  a  means  to  gen- 
erated feedback  that  was  non-threatening  as  well  as  specific  and  positive. 
The  feedback  generated  through  the  expert  system  was  also  timely,  stu- 
dents used  the  expert  system  either  during  or  after  production  at  a  time 
when  corrective  feedback  is  most  valuable  (Van  Houten,  1980)* 

There  were  also  two  indications  that  internally  generated  feedback  encour- 
aged a  different  kind  of  processing  and  learning.  The  first  indication  of  this 
was  the  significant  difference  between  the  two  groups  on  their  evaluations 
of  the  lettering  projects.  This  may  be  due  to  the  complexity  of  the  lettering 
project.  The  lettering  project  had  seven  rather  unfamiliar  criteria  to 
learn,  while  each  of  the  four  other  projects  had  ^nly  five  similar  criteria 
(see  Figure  1).  The  step-by-step  method  of  analyzing  each  criterion  with 
the  expert  system  may  have  given  the  participants  more  memorable  prac- 
tice. The  second  indication  was  the  ability  of  the  internally  generated  feed- 
back group  to  be  more  creative  in  their  evaluations  as  represented  by  their 
ability  to  cite  more  than  the  standard  criteria  and  to  apply  criteria  from 
one  project  to  another.  This  seems  to  indicate  a  more  thorough  learning  of 
all  the  criteria  and  their  applications. 

Finally,  the  opinions  of  the  students  regarding  the  use  of  the  expert  system 
as  part  of  the  instructional  program  was  positive.  The  expert  system  was 
readily  available,  it  was  a  non-threatening  objective  evaluation  procedure, 
and  permitted  the  students  to  take  independent  responsibility  for  a  major 
part  of  their  learning  process. 

It  is  not  the  contention  here  that  the  reason  for  the  results  is  the  medium 
~  only  that  an  expert  system  can  be  an  effective  part  of  a  well  designed 
instructional  system.  The  results  could  probably  be  duplicated  with  more 
thorough  TA  training  or  student  checklists  or  TA  Job  aids.  The  computer 
provides  the  unique  opportunity  to  demand  a  response  (Avner,  Moore,  and 
Smith,  1980)  before  moving  on  ~  it  is  a  way  to  prevent  short  cuts  through 
the  designed  learning  processes.  However,  the  expert  system  provided  an 
instructional  method  that  placed  the  responsibility  for  learning  on  the  stu- 
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dent.  The  Internally  generated  feedback  proved  as  effective  as  the  exter- 
nally provided  feedback  for  the  procedural  tasks  and  better  than  the  exter- 
nal feedback  in  a  declarative  task  such  as  evaluation.    In  other  words,  the 
medium  was  more  suited  to  the  objectives  for  the  learner  (Allen  and  Mer- 
rill, 1985;  Hagler  and  Knowlton,  1987)  in  this  situation. 

The  reliance  on  internally  generated  feedback  with  the  expert  system  raises 
several  additional  questions.  A  basic  question  is  whether  the  expert  system 
that  copies  or  models  an  expert's  reasoning  actually  teaches  the  same  rea- 
soning process  to  the  users.  It  would  also  be  interesting  to  examine  the  im- 
plementation of  a  more  complex  expert  system,  a  system  that  is  composed 
of  many  questions  or  that  attempts  to  actually  grade  a  project  on  a  wider 
scale  than  pass/fail.  The  task  complexity  is  also  another  factor  worth  in- 
vestigation. Writing,  drawing,  or  problem  solving  tasks  may  also  have 
roles  for  internally  generated  feedback. 
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Figure  1 


Production  Crlttrla  for  ProJgcts 


Lottoring 


letter  spacing 
word  spacing 
line  spacing 
clarity 
straight  lines 
layout 
neatness 


Mounting  and  Laminating 

Rubber  Cement  Dry  Mount  Lamination 

stray  adhesive  stray  adhesive  stray  adhesive 

bubbles  or  wrinkles  bubbles  or  wrinkles  bubbles  or  wrinkles 

straight  edges  straight  edges  straight  edges 

layout/margins  layout/margins  layout/margins 

neatness  neatness  neatness 


Cutting 


Name  Plate 


sturdiness 
straight  edges 
cutting  quality 
lettering 
hinge  quality 
neatness 


hinge  quality 
neatness 


straight  edges 
cutting  quality 


finishing  quality 


sturdiness 
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Figure  2 
IxpTt  System  Shell  Sample 


Neatness  Criterion  for  tt?  Easel  Project 

OVERALL  NEATNESS: 

Neatness  is  a  high  priority  for  all  projects. 
It  Is  a  prerequisite,  meaning  that  this  criterion 
must  be  met  before  any  others  will  be  considered. 

PENCIL  MARKS:  When  marking  the  boundaries  of  your  easel 

use  as  few  pencil  marks  as  possible.  And,  make 
the  marks  as  light  as  possible  for  easy  .erasure. 
There  should  be  NO  visible  pencil  marks  on  the 
easel. 

ERASURES:  If  you  need  to  erase  pencil  marks  make  sure  that 

there  are  no  erasures  left  on  the  easel. 

MISCELLANEOUS  MARKS:    Avoid  grease,  coffee  stains,  and  any  other 

material  that  may  make  your  easel  look  sloppy. 

1)  "SATISFACTORY"  means  that  you  have  a  neat,  clean  and  professional 

appearing  product. 

2)  "UNSATISFACTORY"  means  that  you  have  one  or  more  of  the 
 ,  problems  described  above.  

Sturdiness  Criterion  for  Easel  Project 

STURDINESS: 

The  easel  should  be  sturdy  and  solid.  If  the  easel 
bends  or  "bows"  as  it  sits  up  it  is  not  sturdy  enough. 
Generally,  you  should  not  use  poster  board,  which  is 
a  bit  thin  for  easels,  especially  those  taller  than 
three  inches.  You  can  solve  this  problem  by  dry  mounting 
two  pieces  of  poster  board  together  to  make  a  thicker  and 
stronger  piece  of  material  from  which  to  cut  the  easel, 
or  by  using  corrugated  cardboard. 

1)  "SATISFACTORY"  means  that  you  have  a  neat,  clean  and  professional 

appearing  product. 

2)  "UNSATISFACTORY"  means  that  you  have,  one  or  more  of  the 

problems  described  above. 


320 

322 


page  12 


Tablt  1 
Projtct  Scorts 


Expert  System 

Teacher 

Si^nif. 

Lamination 

7.9048 

7.3478 

.603 

Rubber  Cement 

7.3333 

6.9130 

.700 

uty  Mount 

7.9524 

7.6087 

.187 

Cut 

7.1905 

6.5652 

.146 

Lettering 

7.1905 

6.7391 

.372 

Overall  Score 

7.5143 

7.0348 

672 

Tablt  2 

Numbtr  of  Ottails  Cittd  in  Evaluation  Task 

Expert  System 

Teacher 

Sisnif. 

Lamination . 

3.5333 

3.0455 

.618 

Rubber  Cement 

2.8000 

2.1818 

.779 

Dry  Mount 

2.4667 

2.5909 

.740 

Cut 

2.5333 

2.5909 

.301 

Lettering 

2.9333 

2.5455 

.028* 

Tablt  3 

Extra  Dttalls  Mtntiontd  on  Writtan  Evaluation  Task 


 Expert  System  Teacher  Signif. 

Total  No.  Extra  1.6000  1.3043  .015* 
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Tablt  4 

Dcscrlptlvt  Summarits 

 More  Same  Less 


Amount  of  Learning  5  16       .  0 

Better         Same  Bad 
Affect  on  Project  Score  -4  15  2 


Tablt  5 

Overall  Reaction  to  Expert  System 

 negative  01      23456789      10  dps. 

Reaction         ,  l  2     3     4     5     4  2 

Percent  5  9.5    14     19  24      19  9.5 
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Abstract 


This  study  compared  the  effectiveness  of  two 
computer  based  techniques  for  improving  word 
recognition  automaticity  in  children  with  mild 
reading  difficulties.    One  of  the  techniques  provided 
practice  in  identifying  individual  words  out  of 
context,  while  the  other  technique,  referred  to  as 
repeated  reading,  provided  practice  reading  specific 
words  in  context.    Third  and  fourth  graders  with 
reading  skills  at  approximately  the  l8th  percentile 
were  used  as  subjects.    All  children  experienced 
practice  using  both  techniques  applied  to  different 
sets  of  words.    The  repeated  reading  technique  was 
more  effective  than  the  context-free  method  in 
increasing  the  number  of  words  in  children's  sight 
vocabularies  under  both  conte!rt:-free,  and  within- 
context  assessment.    The  repeated  reading  technique 
aloo  required  less  time  per  word  to  reach  a  specific 
mastery  criteria,  and  thus  was  a  more  efficient 
instructional  method. 
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Effects  of  New  Conputer  Technology  on  Increases 
in  Children's  word  Recognition  Automaticity 

The  ability  to  recognize  whole  words  both 
rapidly  and  accurately  is  critical  to  the  acquisition 
of  beginning  -.'eading  skills.    Hence,  a  great  deal  of 
instruction  for  beginning,  moderately  delayed,  and 
disabled  readers  is  focused  on  increasing  the  speed 
and  accuracy,  or  automaticity,  with  which  students 
can  recognize  individual  words.    "Word  recognition 
automaticity**  is  defined  as  the  rapid  and  accurate 
processing  of  whole  words  as  units,  rather  than  the 
use  of  word  attack  skills  to  sound  words  out  for 
identification.    Individual  words  that  are  recognized 
automatically,  regardless  of  whether  they  are 
encountered  in  text  or  in  isolation  are  referred  to 
as  pa2±  of  a  reader's  **sight  word  vocabulary.** 
Consequently,  to  increase  the  n\u»ber  of  words  In  a 
reader's  eight  word  vocabulary,  individual  words  must 
be  recognized  to  a  level  of  automaticity  that 
includes  criteria  in  both  speed  and  accuracy. 

This  study  examined  two  different  computer  based 
methods  for  increasing  word  recognition  automaticity 
in  yoxing  children  with  aild  reading  difficulties.  It 
is  responsive  to  the  broadly  accepted  finding 
(Stanovich,  1986)  that  the  primary  reading  difficulty 
of  many  poor  readers  lies  at  the  word,  rather  than 
the  text,  level  of  processing.    That  is,  the  reading 
progress  of  many  children  in  the  early  elementary 
grades  is  seriously  limited  by  the^r  inability  to 
acquire  skills  in  the  rapid  and  accurate 
identification  of  words.  Both  theory  &nd  data  suggest 
that  difficulties  in  acquiring  efficient  word  reading 
skills  can  be  a  primary  cause' of  inability  to 
comprehend  the  meaning  of  written  material  (Breznitz, 
1987,  Lesgold  &  Resnick,  1982;  Perfetti,  1985). 

When  young  children  read  individual  words,  they 
utilize  at  least  three  different  methods  for  vord 
recognition.    Perfetti  (1984)  refers  to  these  methods 
as  involving  different  representational,  or  codin 
systems.    Some  words,  for  example  are  recognized  as 
whole  units.    *'Word  identification  occurs  for  these 
words  when  a  string  of  visually  encoded  letters 
triggers  the  word  representation  constructed  from 
frequent  encounters  with  the  word**  (p. 52)  .  Other 
words  are  recognized  because  they  contain  specific 
letter  strings  or  groups.    These  letter  patterns  have 
acquired  a  representational  status  because  they  occur 
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frequently  in  many  different  words.    A  third  level  of 
representation  involves  grapheme-phoneme 
correspondences.    Words  can  be  identified  by 
approximating  their  spoken  sound  through  analysis  of 
sounds  represented  by  individual  letters  and  letter 
groups . 

In  his  model,  Perfetti  (1984)  suggests  that 
children  learn  all  three  representational  systems 
(whole  words,  high  frequency  letter  groups,  grapheme- 
phoneme  relationships)  simultaneously,  and  that  they 
can  provide  useful  support  to  one  another  in  the 
acquisition  of  fluent  word  identification  skills.  In 
our  research,  we  focus  on  methods  to  increase  the 
number  of  words  that  children  can  recognize  as  whole 
xinits.    This  type  of  recognition  usually  recpiires 
less  time  than  the  other,  more  analytic  methods  of 
word  recognition,  and  thus  it  is  one  way  to  help 
improve  the  reading  speed  of  children  who  are 
experiencing  difficulty  in  acquiring  fluent  reading 
skills. 

Both  of  the  methods  for  increasing  word  reading 
efficiency  evaluated  in  this  experiment  utilize  newly 
developed  micro-computer  technology  to  assist  in 
presentation  of  Instructional  material  and  evaluation 
of  responses.    Although  both  of  the  techniques  can  be 
implemented  using  more  stand&rd  materials,  computer 
presentation  greatly  facilitates  the  measurement  of 
response  speed,  which  is  a  crucial  variable  in 
determining  mastery  of  individual  words. 

One  of  the  techniques  involves  context-free 
practice  on  word  lists.    This  technique  is  used 
widely  by  teachers  to  increase  the  sight  vocabulary 
of  young  children,    it  is  essentially  a  form  of 
pared-associate  learning,  in  which  children  are  shown 
individual  words  one  at  a  time  and  must  learn  to 
respond  quickly  with  appropriate  pronunciation. 
Typically,  word  lists  are  practiced  repeatedly,  with 
the  goal  of  producing  rapid  and  accurate 
identification  of  words  on  the  list. 

The  other  technique  we  evaluated  involves  the 
repeated  oral  reading  of  short  passages  containing 
words  that  the  children  are  to  learn.    This  technique 
has  been  shown  to  produce  generalized  increases  in 
reading  fluency  in  disabled  readers  (Moyer,  1982), 
and  there  is  evidence  suggesting  that  it  primarily 
affects  the  speed  with  which  individual  words  are 
recognized  (Rashotte  &  Torgesen,  1985) .  By 
repeatedly  reading  the  seune  passage  over  and  over, 
children  acquire  sufficient  experience  with 
individual  words  to  allow  development  of  the  ability 
to  respond  to  many  of  the  words  as  whole  word  units. 

Although  both  of  these  techniques  have  been 
evaluated  positively  in  previous  research,  we  are 
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aware  of  no  studies  that  contract  their  effectiveness 
with  one  another.    Given  the  proliferation  of 
computer  based  techniques  for  Increasing  reading 
skills,  It  Is  becoming  Increasingly  Important  to 
understand,  not  only  whether  a  technique  Is  effective 
or  not,  but  also  about  the  relative  efficacy  of 
different  techniques  developed  for  the  same  purpose. 
In  this  study,  we  examine  the  relative  effectiveness 
of  both  techniques  to  increase  the  sight  word 
vocabulary  of  mildly  impaired  readers.    Our  dependent 
measures  include:  1)  short-term  Improvements  in 
context-free  word  recognition  speed;  2)  long-term 
Improvements  in  both  wlthin-context  and  out  of 
context  recognition  speed;  and  3)    instructional  time 
to  achieve  mastery  as  measured  by  a  context-free 
diagnostic  progress  test. 

Method 

Subjects 

Subjects  were  16  third  and  fourth  grade  students 
attending  an  elementary  school  serving  a  population 
of  mixed  SES.    The  students  were  identified  as 
moderately  delayed  readers  by  their  classroom 
teachers.    Their  meem  overall  reading  scores  on  the 
Comprehensive  Assessment  Program:  Achievement  Series 
(1985)  was  at  the  ISth  percentile.    The  students  were 
randomly  assigned  to  two  groups  of  equal  size. 

Assessment  and  Instructional  Methods  and  Procedures 

Sets  of  materials  were  developed  by  the 
principal  investigator  for  both  testing  and 
instructional  conditions.    The  assessment  materials 
will  be  described  first,  followed  by  those  used  in 
instruction. 

Word  recognition  screening  test,    A  list  of 
words  Introduced  in  the  basal  reader  series  during 
fourth  grade  was  obtained . from  teachers.    These  words 
were  divided  into  lists  of  20  words  and  presented  one 
at  a  time  on  the  computer  to  each  subject.  The  words 
were  presented  in  lower  case  text,  and  students  were 
Instructed  to  respond  as  rapidly  as  possible.  The 
examiner  pressed  a  key  immediately  following  an 
accurate  pronunciation  of  a  word.    The  computer 
recorded  elapsed  time  between  the  appearance  of  a 
word  and  the  button  press  indicating  a  correct 
response.    After  a  correct  response,  or  after  five 
seconds  had  elapsed,  the  word  disappeared  and  a  new 
word  appeared. 

Analysis  of  responses  to  the  screening  test 
resulted  in  a  list  of  eighty  words,  none  of  which 
were  part  of  the  sight  vocabulary  of  any  of  the 
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subjects.    A  word  was  defined  as  part  of  a  student *s 
sight  vocabulary  if  it  was  pronounced  correctly  in 
under  three  seconds.    Although  this  criteria  may  seem 
a  bit  slow  for  recognition  of  sight  words,  response 
times  in  this  study  included  the  time  it  took  for  the 
examiner  to  recognize  a  correct  response  and  push  he 
timing  button.    Thus,  response  times  are 
approximately  .6-. 8  seconds  slower  than  they  would 
have  been  with  a  more  direct  measurement  technology. 
This  delay  in  response  measurement  occurs 
consistently  in  all  conditions  of  the  study,  so  the 
basic  comparative  purposes  are  not  compromised. 

The  80  words  were  first  stratified  by  parts  of 
speech,  and  then  randomly  assigned  to  two  sets.  The 
first  set  consisted  of  sixty  to-be-taught  (target) 
words,  and  the  second  set  consisted  of  twenty  no 
treatment  control  words  (non-target  words)  for  which 
no  instruction  would  be  provided.    The  sixty 
target  words  were  randomly  assigned  to  four  sets  of 
fifteen  wore?  .    Each  set  was  then  randomly  assigned 
to  one  of  four  instructional  weeks.  The  twenty  non- 
target  words  were  randomly  assigned  to  four  sets  of 
five  words.    Each  set  was  then  randomly  assigned  to 
one  of  the  four  instructional  weeks. 

Diacmostic  progress  test,    A  diagnostic  progress 
test  was  prepared  for  each  of  the  four  target  word 
sets.    The  fifteen  target  words  were  presented  once, 
in  random  sequence.    The  diagnostic  progress  test  was 
administered  during  the  instructional  sessions  in 
order  to  determine  if  words  in  a  given  practice  set 
had  been  mastered.    Again,  mastery  was  defined  as 
being  able  to  pronounce  a  word  accurately  within 
three  seconds c    The  testing  format  was  identical  to 
the  format  of  th'  word  recognition  screening  test. 

Imnediate  context-free  posttest.    Four  immediate 
context-free  posttests  were  prepared.    Each  test 
consisted  of  a  set  of  fifteen  target  words  and  a  set 
of  five  non-target  words  presented  once,  in  random 
sequence.    These  tests  were  administered  on  the 
Monday  immediately  following  a  week  of  practice  for  a 
given  wordset.    The  testing  format  was  identical  to 
the  format  of  the  word  recognition  screening  test. 

Delayed  context-free  posttest.    The  delayed 
context-free  posttest  contained  the  sixty  target 
words,  and  the  twenty  non-target  words  presented 
once,  in  random  sequence.  To  prepare  the  test,  15 
target  words  and  5  non-target  words  were  randomly 
assigned  to  four  sets  of  twenty  words.    This  test  was 
given  three  weeks  following  the  conclusion  of  all 
training.    The  testing  format  was  identical  to  the 
format  of  the  word  recognition  screening  test. 

Delayed  in-context  posttest,    the  delayed  in- 
context  posttest  consisted  of  the  sixty  target  words 
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and  the  twenty  non-target  words  presented  once,  in 
four  novel  stories.    To  construct  the  test,  15  target 
words  and  5  non-target  words  were  randomly  assigned 
to  four  sets  of  twenty  words.    Then,  four  unique 
stories  were  developed,  each  containing  a  set  of 
target  and  non-target  words.    The  number  of  words  in 
the  stories  ranged  from  176  to  192,  with  an  average 
length  of  183  words.    Mean  readability  of  the  stories 
was  at  the  third  grade  level  (Fry,  1968) .  stories 
were  presented  in  upper  and  lower  case  letters  on  the 
computer  screen. 

The  students  were  instructed  to  read  each  story 
aloud  once.    They  were  told  to  read  as  fast  as  they 
could,  without  making  any  errors.    They  were  informed 
that  they  would  receive  no  help  on  difficult  words. 
If  they  were  unable  to  recognize  a  word  within  five 
seconds,  the  students  were  instructed  to  skip  over 
the  word  emd  continue  reading  when  they  heard  the 
examiner  articulate  the  cue,  "go  on."    All  readings 
were  taped  for  later  analysis.    A  word  was  counted  as 
part  of  a  student's  sight  vocabulary  if  it  was 
pronounced  accurately  within  three  seconds  after  the 
preceding  word  had  been  articulated,  or  if  it  was 
pronounced  accurately  within  three  seconds  after  the 
cue  "go  on"  was  heard.    This  test  was  given  at  the 
same  time  as  the  delayed  context-free  posttest.  Half 
the  subjects  received  this  test  first,  while  the 
other  half  was  tested  in  the  opposite  order. 

Repeated  reading  instructional  materials.    A  set 
of  stories,  each  consisting  of  three  unique  stories, 
was  developed  for  eacdi  week  of  instruction.  Each 
story  contained  the  fifteen  words  in  a  target  set 
presented  once.    The  number  of  words  in  the  stories 
ranged  from  165  to  192,  with  an  average  length  of  170 
words.    Mean  readability  of  the  stories  was  at  the 
third  grade  level  (Fry,  1968) .    Four  multiple  choice 
questions  with  three  answer  possibilities  were 
prepared  for  each  story.    The  questions  referenced 
facts  stated  in  the  story;  however,  none  of  the 
questions  nor  answers  included  target  words. 

All  stories  were  presented  via  the  repeated 
reading  shell  of  the  Lessonmaster  Authoring  System 
(Brezin  &  Wager,  1987) .    This  shell  can  present 
customized  material  in  easy  to  read,  upper  and  lower 
case  text,  for  multiple  presentations. 

The  students  were  instructed  to  read  the  stories 
aloud  four  times.    They  wee  told  that  all  reading 
errors  would  be  corrected  during  the  first  two 
readings.    The  experimenter  or  assistant  listened, 
but  did  not  offer  corrections  during  the  final  two 
readings.    Immediately  following  each  reading  of  a 
story,  a  unique  multiple  choice  question  was 
presented,    students  received  immediate  feedback 
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concerning  the  speed  with  which  they  read  the  story 
and  the  accuracy  of  their  response  to  the 
comprehension  question.    Following  the  four 
repetitions,  they  received  graphic  feedback,  in  the 
form  of  a  bar  graph  that  showed  how  fast  they  read 
each  repetition  of  the  story. 

The  students  were  allowed  to  play  a  computer 
dart  game  following  the  fourth  reading  of  a  story. 
They  were  told  that  they  would  earn  extra  playing 
time  for  correct  answers  and  for  faster  reading 
speeds. 

Students  practiced  a  given  set  of  target  words 
with  the  repeated  reading  technique  for  four  20 
minute  sessions,  or  until  they  reached  a  specified 
criterion  of  performance  on  the  target  words  (all  the 
words  correctly  pronounced  within  three  seconds) . 
Once  this  criterion  was  met,  practice  continued  for 
the  present  session,  but  the  student  did  not  have  to 
return  again  that  week.    The  diagnostic  progress  test 
was  given  immediately  following  the  completion  of 
four  repetitions  of  each  story.    Thus,  if  after 
practicing  the  words  by  reading  story  1  four  times, 
the  child  accurately  read  all  the  target  words  within 
three  seconds,  performance  criterion  for  the  repeated 
reading  condition  had  been  met.    If  the  criterion  was 
not  met  following  the  fourth  reading  of  stories  2  or 
3,  and  four  practice  days  had  not  elapsed,  students 
continued  to  practice  the  target  words  with  the 
repeated  reading  technique  by  rereading  stories  1,  2, 
and  3.    Practice  on  a  given  word  set  was  discontinued 
after  four  20  minute  sessions,  i^  mastery  was  not 
achieved. 

Context-free  condition.    Three  sets  of  context- 
free  lessons  were  developed  for  each  week  of 
instruction.    Each  lesson  contained  all  o't  the  words 
in  a  given  target  set,  and  consisted  of  a  series  of 
multiple  choice  items.    The  lessons  were  developed 
using  the  Matching  Shell  of  the  Lessonmaster 
Authoring  System  (Brezin  &  Wager,  1987) .    The  format 
selected  froia  this  shell  involved  the  auditory 
presentation  of  a  word,  and  a  sentence  using  the 
word,  via  digitized  speech  followed  by  the  visual 
presentation  of  three  words  in  lower  case  text.  The 
child's  task  was  to  choose  the  word  pronounced  by  the 
computer.    To  respond  to  an  item,  a  student  first 
pressed  a  number  on  the  keyboard  that  moved  a  box  to 
surround  the  selected  word,  and  then  pressed  another 
key  to  complete  the  response.    Immediate  feedback  was 
provided  following  each  response.    For  incorrect 
responses,  and  for  responses  not  completed  within 
five  seconds,  the  box  automatically  moved  to  surround 
the  target  word.    Distractor  words  appeared  similar 
to  the  target  word  to  discourage  guessing  based  on 
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first  letter  consonant  sounds,  and  nvunber  of 
sylleO^les  heard.    The  three  practice  lessons  In  a  set 
differed  only  on  the  words  used  as  foils  In  the 
multiple  cholco  Items. 

After  a  student  had  responded  to  all  of  the 
Items  In  a  lesson,  a  chart  appeared  on  the  screen. 
It  displayed  the  number  of  correct  responses, 
Incorrect  responses,  no  responses,  and  the  average 
number  of  seconds  taken  for  correct  responses.  After 
responding  to  each  Item  In  a  lesson  four  times,  the 
student  pressed  a  key  to  access  the  computer  dart 
game.    As  In  the  repeated  reading  condition,  the 
students  were  told  that  they  would  receive  extra 
playing  time  for  correct  and  for  rapid  responses. 
Following  the  dart  game,  students  were  administered 
the  diagnostic  progress  test.    Subsequent  practice  In 
the  context  free  condition  was  administered  following 
the  same  mastery  rules  as  used  In  the  repeated 
reading  condition. 

Experimental  design  and  procedure 

This  study  employed  a  within  group,  repeated 
measures  design.    The  design  was  counterbalanced  to 
ensure  that  all  students  received  opportunity  for 
equivalent  Intervals  of  Instruction  under  both 
Instructional  conditions.    All  instruction  and 
practice  was  provided  in  a  computer  lab  setting  using 
Apple  II  series  microcomputers.    For  the  first  week, 
group  1  received  repeated  reading  instruction  on  word 
set  A,  and  group  2  received  context-free  instruction 
on  word  set  A.    Following  instruction,  the  immediate, 
context-free  posttest  was  administered  to  both  groups 
consisting  of  word  set  A  and  non-treatment  word  set 
E.    During  the  second  week,  group  l  received  context- 
free  instruction  on  word  set  B,  and  group  2  received 
repeated  reading  instruction  on  word  set  B. 
Following  instruction,  a  context-free  posttest  was 
administered  to  both  groups  consisting  of  word  set  B 
and  non-treatment  word  set  Fj^   This  procedure  was 
repeated  for  a  total  of  four  weeks,  with  the  groups 
rotating  until  both  groups  had  experienced  each 
instructional  condition  twice.  The  delayed  posttests 
were  administered  to  all  subjects  three  weeks  after 
the  last  instructional  week.    A  diagram  of  the 
experimental  design  can  be  seen  in  Table  1. 


Insert  TeUDle  1  about  here 
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Reliability  of  dependent  measures 

The  inter-rater  relieUaility  for  the  number  of 
words  accurately  pronounced  within  three  seconds  was 
determined  by  comparing  the  accuracy  and  speed 
measurements  of  two  judges  on  twenty  five  percent  of 
the  total  responses.    RelieOsility  was  computed  by 
dividing  the  number  of  agreements  by  the  total  number 
of  agreements  and  disagreements.    Reliability  for  the 
context-free  testing  format  was  98.5%,  while  that  for 
the  in-context  format  was  98.7%. 

Results 

Although  the  non-treatment  words  were  included 
in  the  posttests,  they  were  not  included  in  the 
statistical  analyses.    The  basic  purpose  of  the 
experiment  was  not  to  determine  whether  the 
instructional  techniques  were  effective  by 
themselves,  but  rather  to  answer  questions  eOsout 
their  relative  effectiveness  compared  to  each  other. 
The  nonrtreatment  words  are  useful  primarily  to 
estimate  the  effects  that  experiences  outside  the 
experiment  might  have  had  on  children's  ability  to 
read  the  words  included  in  the  practice  sets.  The 
Geisser-Greenhouse  (negatively  biased)  conservative 
degrecis  of  freedom  were  used  in  all  tests  of 
significance.    This  test  adjusts  for  the  fact  that, 
in  some  cases,  our  data  did  not  meet  the  requirements 
of  compound  symmetry  and  homogeneity  of  variance 
(Winer,  1971) . 

Table  2  presents  the  means  and  standard 
deviations  for  percentage  of  words  in  sight 
vocabulary,  and  actual  speed  of  response  for  words  in 
sight  vocabulary,  for  each  of  the  instructional 
conditions.    It  is  importauit  to  remember  that  all  16 
subjects  contributed  data  to  each  cell  of  this  table. 
That  is,  the  data  in  each  cell  represent  the  mean  of 
each  subject's  performance  for  two  weeks  of 
instruction  in  each  condition.    The  descriptive  data 
for  non-treatment  words  is  included  for  comparison. 


Insert  Table  2  about  here 


A  2  (instructional  condition)  x  3  (testing 
condition)    ANOVA  with  repeated  measures  on  both 
factors  was  conducted  on  the  percentage  of  words  in 
sight  vocabulary  xinder  the  three  posttest  conditions. 
The  analysis  indicated  significant  main  effects  of 
instructional  condition  £  (1,15)  »  20.84,  p  <.01,  and 
testing  condition  f  (2,  30)  «  34.02,  p  <.01.  In 
addition,  there  was  a  significant  interaction  between 
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Instructional  condition  and  testing  condition  z  (2, 
30)  «  4.88,  p  <.05.    Tests  of  simple  main  effects 
showed  that  there  were  significant  differences 
(p  <.01)  between  instructional  conditions  at  all 
testing  points,  although  the  differences  were  smaller 
on  the  delayed,  in-context  measure  than  the  other  two 
posttests.    The  results  indicate  that  the  repeated 
reading  technique  was  more  effective  than  the 
context-free  instructional  method  in  increasing  the 
number  of  words  in  the  sight  voceUaulary  of  mildly 
reading  disabled  children. 

The  speed  data  indicate  that,  for  words  in  sight 
vocabulary,  both  methods  led  to  equivalent  speed  of 
responding,    visual  comparison  of  data  from  the 
treatment  conditions  with  the  no-treatment  words 
shows  that  subjects  maintained  relatively  low  levels 
of  responding  to  unpracticed  words  in  both  context- 
free  testing  conditions.  The  relatively  higher 
response  values  in  the  in-context  testing  condition 
indicate  the  degree  of  support  for  individual  word 
reading  provided  by  the  context  of  the  stories  within 
which  they  were  imbedded.    This,  of  course,  helps  to 
explain  the  better  performance  in  this  testing 
conditions  for  words  taught  in  both  instructional 
conditions. 

A  second  analysis  was  conducted  to  determine  if 
the  instructional  condition  under  which  words  were 
taught  differentially  affected  performance  on 
posttests  requiring  in-context  and  context-free  word 
recognition.    A  2  (instructional  condition)  x  2 
(testing  condition)  ANOVA  was  conducted  using  just 
the  delayed  in-context,  and  delayed  context-free 
tests.    The  main  effects  of  instructional  condition  F 
(1,15)  «  16.22,  p  <.01,  and  testing  conditior.  £ 
(1/15)  «  42.61,  p  <.01  were  significant;  however, 
there  was  no  significant  interaction  between 
instructional  condition  and  testing  condition  £ 
(1,15)    »  2.12,  p  >.10.    The  failure  to  find  an 
interaction  suggests  that  the  condition  under  which  a 
word  was  taught  (in  context  or  out  of  context)  did 
not  differentially  affect  the  probability  that  it 
would  be  part  of  a  child's  sight  vocabulary  under  the 
two  different  (in-context  or  context-free)  testing 
conditions. 

A  third  analysis  was  conducted  to  determine  if 
the  two  instructional  techniques  were  differentially 
affective  in  producing  learning  that  maintained  its 
effects  over  a  relatively  long  retention  interval.  A 
2  (instructional  condition)  x  2  (testing  condition) 
ANOVA  with  repeated  measures  was  conducted  on  the 
percentage  of  words  in  sight  vocabulary  on  the 
context-free  (immediate  and  delayed)  posttests.  The 
main  effects  of  instructional  condition  £  (1,15)  = 
21.15,  p  <.01,  and  testing  condition  £  (1,15)  « 
36.53,  p  <.oi  were  significant;  however,  there  was  no 
significant  interaction  between  instructional 
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condition  and  testing  condition  £  (1,15)  -  2.38, 

p  >.10.    Thus,  both  techniques  produced  learning  that 

was  equally  resistant  to  decay  over  time. 

In  order  to  answer  questions  about  the  relative 
efficiency  of  the  two  techniques  in  producing 
increases  in  sight  vocabulary,  we  analyzed  the 
results  of  the  first  administration  of  the  diagnostic 
progress  test.    The  first  administration  of  the  test 
was  used  in  order  to  stemdardize  measures  across  the 
two  instructional  treatments.    That  is,  all  students 
were  given  the  test  at  least  once  for  each  of  the 
four  target  word  sets;  however,  some  students  did  not 
have  the  opportunity  to  take  more  than  one  diagnostic 
progress  test  for  a  given  set. 

Two  separate  time  to  master  measures  were  used. 
The  first,  "actual  time,"  included  the  total  time  to 
use  the  lessons  prior  to  attainment  of  mastery.  The 
second,  "adjusted  time,"  excluded  all 
noninstructional  time  (time  to  change  discs,  time  for 
program  tc^  execute,  etc.).    The  actual  time  measure 
evaluated  the  efficiency  of  the  computer  programs, 
and  the  adjusted  time  evaluated  the  efficiency  of  the 
instructional  techniques. 

The  average  number  of  minutes  a  student  spent 
practicing  a  given  target  word  prior  to  mastering  the 
word  was  calculated  for  each  student  in  each 
instructional  condition,  for  both  actual  and  adjusted 
time.    To  derive  the  "minutes  per  word"  measures, 
both  tlie  actual  and  the  adjusted  time  spent  to  master 
the  words  in  a  given  15  word  target  set  were  divided 
by  the  number  of  words  mastered.    Table  3  depicts  the 
means  and  the  standard  deviations  of  the  minutes  per 
word  measures  for  both  actual  and  adjusted  time. 


Insert  Table  3  about  here 


Two  separate  one  >vay  ANOVAs  with  repeated 
measures  were  conducted.    The  first  analysis  was 
performed  on  the  minutes  of  practice  to  master  a  word 
for  actual  time,  z  (1,15)  »  7.51,  p  <.oi,  and  the 
second  was  performed  on  the  average  minutes  of 
practice  to  master  a  word  for  adjusted  time  £  (1,16) 
-  6.12,  p  <.05.    The  results  of  both  analyses  suggest 
that  the  repeated  reading  technique  was  more 
efficient,  in  terms  of  the  time  required  to  move 
words  into  a  child's  sight  vocabulary,  than  the 
context-free  method. 

Discussion 

On  the  basis  of  this  study,  our  conclusion  is 
that  the  repeated  reading  technique  is  more 
effective  than  context-free  word  practice  in 
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Improving  the  sight  vocabulary  of  mildly  handicapped 
readers.    Of  course,  this  conclusion  is  tied  in 
important  ways  to  the  two  particular  computer 
programs  that  were  used  to  implement  each  technique. 
The  major  evidence  for  our  conclusion  is  that  the 
repeated  reading  technique  produced  a  higher 
percentage  of  words  in  sight  vocabulary  under  all 
testing  conditions,  and  that  it  required  less 
instructional  time  to  achieve  mastery  over  each 
word. 

At  least  two  aspects  of  these  findings  require 
additional  comment.  First,  it  was  mildly  surprising 
to  find  that  method  of  instruction  did  not 
differentially  effect  level  of  performance  under  two 
different  methods  of  assessment.    That  is,  words 
learned  under  context-free  instruction  were  not  more 
easily  read  in  the  context-free  testing  condition, 
nor  did  repeated  reading  instruction  have  a  specially 
large  impact  on  words  tested  in  the  in-context 
condition.    Since  the  only  cues  for  word  recognition 
provided  in  the  context-free  testing  condition  are 
those  in  the  graphic  word  representation,  it  appears 
that  children  were  learning  to  respond  to  these  cues 
while  they  read  the  words  in  context  in  the  repeated 
reading  condition.    This  finding  is  important, 
because  it  suggests  that  the  repeated  reading 
technique  can  produce  generalized  increases  in  text 
processing  fluenny  at  least  partially. because  it 
enables  children  to  respond  more  iif^ipidly  to  the 
graphic  cues  contained  in  individual  words.  These 
words  will  then  ba  read  more  rapivtly  and  accurately, 
rftgardless  of  the  context  in  which  they  appear. 

Our  second  point  of  discussion  involves  the 
question  of  the  relative  efficiency  of  the  two 
techniquee  ivi  producing  mastery.    The  answer  to  this 
ques<:ion,  of  course,  depends  to  a  iJirge  extent  on  the 
way  each  tachnique  is  implemented  in  its  specific 
computer  program.    Afs  it  turned  out  in  this  study, 
the  context-frse  technique  simply  required  more  time 
to  >2x:ecute  many  of  its  operations  than  cJ^'l  the 
repeated  reading  techr:iiiue.    Although  cu-..iful 
procedures  were  employed  to  deduct  noninstructional 
time  from  the  actual  time  spent  using  the  lessons  for 
both  condition:-?,  the  adjusted  times  for  the  two 
instructional  techniques  may  not  be  equivalent. 
That  is,  the  adjusted  time  in  the  context-free 
technique  may  not  be  representative  of  all  context- 
free  techniques,  such  as  the  use  of  flashcards  by 
teachers.    The  question  of  relative  efficiency  might 
be  answered  differently  if  a  different  computer 
program  had  been  used  to  present  the  context-free 
method. 
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The. point  remains,  however/  that  even  though  the 
repeated  reading  technique  required  children  to  read 
stories  containing  many  words  in  addition  to  the 
target  words,  it  was  still  a  relatively  efficient  way 
to  improve  children's  sight  vocabulary.    Because  this 
technique  may  also  provide  experience  that  improves 
general  text-processing  and  comprehension  skills 
(Moyer,  1982) ,  it  seems  a  very  promising  method  to 
help  children  increase  the  fluency  of  their  reading. 
A  major  constraint  on  the  use  of  the  technique, 
however,  is  that  children  must  have  sufficient 
reading  skill  in  order  to  read  and  comprehend 
connected  text  before  it  can  be  used  effectively. 
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Table  1 

Diagram  of  Experimental  Design 
Week 

Number  Group  1  Group  2 


Repeated  reading, 
Word  set  A 

Immediate  posttest, 
Word  sets  A  and  E 

Context-free, 
Word  set  B 

Immediate  posttest, 
Word  sets  B  and  F 

Repeated  reading, 
Word  set  C 

Immediate  posttest. 
Word  sets  C  and  G 

Context-free, 
Word  set  D 

Immediate  posttest. 
Word  sets  D  and  H 


Context-free, 
Word  set  A 

Immediate  posttest. 
Word  sets  A  and  £ 

Repeated  reading. 
Word  set  B 

Immediate  posttest. 
Word  sets  B  and  F 

Context-free, 
Word  set  C 

Immediate  posttest. 
Word  sets  C  and  G 

Repeated  reading. 
Word  set  D 

Immediate  posttest. 
Word  sets  D  and  H 


Delayed  posttests. 
Word  sets  A  -  H 


Delayed  posttests. 
Word  sets  A  -  H 


NOTE:  Wordsets  A  -  D  consist  of  to-be-taught  words, 
and  word^^ts  E  -  H  consist  of  non-treatment  words. 
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Table  2 

Percentage  of  Words  in  Sight  Voeabularv  and  Speed  of 
Response  as  a  Function  of  Instructional  and 
Posttest  Conditions 

Posttcat  Condition 


Innediate  Delayed 
Instructional        Context-       Delayed  Context- 
Condition  Free  In-Cc..text  Free 


Repeated  Reading 

Percentage  X  88  88  62 

of  words  SD  18  14  29 

Speed  of  X  1.9  1.0  2.1 

response  SD  .44  .46  .44 

Context-Free 

Percentage  X  61  74  4i 

of  words  SD  33  25  32 

Speed  of  x  1.9  1.1  2.1 

response  SD  .45  .56  .43 

Non-Treat»ent 
Control  Condition 

Percentage  X  09  52  lo 

of  words  SD  16  24  16 

Speed  of  X  2.3  1.3  2.2 

response  SD  .45  .57  .45 


Note:    Speed  of  response  reported  in  seconds 
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Table  3 

Actual  and  Adjusted  Time  to  Master  a  Word  in  Both 
Instructional  Conditions 


Instructional 
Condition 


Minutes  per 
Word/  Actual 
Time 


Minutes  per 
Word/  Adjusted 
Time 


Repeated  Reading  X 

SD 


3.36 
3.08 


2.77 
2.64 


Context-Free 


X 
SD 


12.57 
15.89 


8.07 
10.59 


341 

343 


Title: 

Applications  of  Artificial  Intelligence  to 
Information  Search  and  Retrieval: 
The  Development  and  Testing  of  an 
Intelligent  Technical  Information  System 

Author: 

Francis  A.  Harvey 


343 
344 


Applications  of  Artificial  Intelligence  to  Information 

Search  and  Retrieval:  The  Development  and 
Testing  of  an  Intelligent  Technical  Information  System 


ErancisA.  Harvey 

College  of  Education 
Lehigh  University 
Bethlehem,  Pennsylvania  18015-4793 


A  paper  presented  at  the  annual  conference  of  the 
Association  fpr  Educational  Communications  and  Technology 
New  Orleans,  Louisiana 
19  January,  19.88 


344 

345 


Development  of  an  Intelligent  Technical  Moimation  System 

1 


Abstract 

Problems  associated  with  corq)uter-bascd  inforaiation  access  as  currently  practiced  include 
the  sheer  volume  of  informadon  available,  the  rapidly  changing  nature  of  that  information,  and  the 
difGcul^  iMviduals  face  in  attempting  to  evaluate  all  knowledge  relevant  to  a  particular  problem. 
The  increasing  availability  of  large  data  bases  on  optical  disc  h^  exacerbated  the  problem,  since 
search  and  retrie^^  ibchnolp^  has  not  tept  pace  witii  advances  in  data  capacity.  Intelligent  data 
bases,  which  attonpt  to  combine  techniques  used  in  artificial  intelligence  for  knowledge 
represratation  and  die  development  of  knowledge-based  systems  witii  the  highly  refined  data  base 
techniques  aheady  developed  to  store  lar^  amounts  of  carefiilly  structured  and  organized  data, 
provide  a  potential  solution  to  the  problem  of  information  overload  faced  by  professionals  in  all 
fields. 

This  psq)er  describes  die  evoluticm  and  development  of  one  information  system,  the 
knowledge  bttse  for  steel  structures  bdng  developed  as  part  of  the  Technical  Information  Center  for 
Steel  Stmctmcs  (TICSS)  at  Lehigh  University's  Center  for  Advanced  Technology  for  Large 
Structural  Systems  (ATLSS),  which  is  funded  by  die  National  Science  Foundation.  The  paper 
discusses  die  initial  development  of  liic  Technical  Informatics  Center  and  reviews  the  decisions  on 
hardware  and  software  rnade  in  the  first  year  as  the  project  goals  were  refined,  particularly  die 
selection  ofTurboProlc^  as  die  programmhg  1m         The  computer-based  Wbliographic  data 
base  desired  during  the  first  year  of  the  project  and  now  under  development  is  described,  and 
lesscms  gained  fixxn  die  experience  and  Aeir  iri^act  on  the  future  directicm  of  die  project  are 
discussed.  Projected  fiiture  activities  -  including  testing  of  the  bibliographic  system,  expansion  of 
diat  system  into  a  complete  knowledge  based  system,  ami  the  conversion  of  the  system  to  optical 
disc  (CD/ROM)  storage  format  -  and  poter>tial  research  questions  associated  witii  developuig  and 
using  "intelligent"  information  systems  are  also  discussed. 
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Applications  of  Artificial  Intelligence  to  Information  Search 
and  Retrieval:  T!r^  Development  and  Testing  of  an 
Intelligent  Technical  Information  System 


Introduction:  Current  Problems 

Professionals  in  nearly  every  area  of  erlucation,  business,  and  industry  are  challenged  by  a 
flood  of  raw  information  which  can  overwhelm  human  comprehension.  Computerized  data  bases 
now  exist  which  provide  access  to  vast  anx>unts  of  informaticxi,  and  the  amount  of  information  is 
growing  and  changing  rapidly,  approximately  doubling  every  eight  years.  The  introduction  of 
optical  disc  (CD/ROM)  storage  technology  as  a  microcomputer  paipheral  has  expanded  access  to 
infomiation  and  at  the  same  time  exac^bated  the  problems  of  infinmation  management  and 
utilization. 

A  Potential  Solution  to  Information  Overload:  Intelligent  Data  Bases 

A  potential  solution  to  the  problrai  of  infOTmaticm  ovo'load  exists  in  the  form  of  the 
development  of  "intelligent  data  b^."  Intelligent  data  bases  attempt  to  coniWne  techniques  used 
in  artificial  intelligoicc  for  knowledge  rqaesratatioh  and  the  development  of  knowledge-based 
systems  with  existing  data  base  managpmmt  techniques  developed  to  store  large  amounts  of  data. 

bitelfigent  dam  bases  take  advantage  of  die  existing  power  and  flexitdlity  of  traditional 
relaticmal  dam  base  mahaganent  systems  (DBMS)r  Eusting  DBMS's  have  die  advantage  that  diey 
are  aheady  developed  and  highly  refined,  tiiat  they  can  stcro  large  amounts  of  information,  and  that 
die  inf ormaticm  is  carefiiUy  stractured  and  well  organized. 

Jntclligait  data  bases  ^ply  die  technology  of  expert  systems  to  help  researchers  identify 
and  focus  attention  on  information  relevant  to  a  particular  problem.  An  e)^pert  system  is  "a 
COTiputing  system  capable  of  representing  and  reascming  about  some  faiowiedge-rich  domain,  such 
as  internal  rnedicine  or  geology,  with  a  view  to  solving  problemr.  and  giving  ad\ice"  (Jackson, 
1986, 1).  Figure  1  illustrates  die  two  noiajor  components  of  an  expert  system,  tt  j  inference  engine 
and  the  knowledge  base,  and  the  iri^jrrelationships  between  those  coniponents. 


Figure  1 

The  Structure  of  an  Expert  System 


The  Inference  Engine 

(Carries  out 
Reasoning 

Proc€^sses) 


r 


The  Knowledge 

Base 
(Rules,  Facts, 
Prior  Experience) 


Bodi  the  specific  information  about  the  domain  (that  is,  facts)  and  the  process  by  which  a 
human  "e;q)ert"  would  solve  problems  in  that  domain,  are  represented  symbolically  in  an  expert 
systeoL  Techniques  used  to  represent  knowledge  include  die  use  of  production  rules,  structured 
objects,  and  predicate  logic.  For  example,  in  an  intelligent  data  base  rules  such  as  constraint 
checks  or  checks  on  the  integrity  of  information  referenced  by  die  record  can  be  associated  with  a 
data  base  record,  resulting  in  a  data  base  made  up  of  active  or  intelligent  objects. 
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A  Case  Study:  A  Knowledge  Base  for  Steel  Structures 

DcvelqMiT^Kt  of  one  such  intelligent  data  tese  is  currently  in  progress  at  the  Technical 
Information  Center  for  Steel  Structures  (TICSS)  at  Lehigh  University  (Harvey,  Stewart,  and 
Bcedle,  1987X  TICSS  is  pwi  of  the  Center  for  Advanced  Technology  for  Large  Structural 
Systems  (ATLSS),  an  En^cering  Research  Center  at  Lehigh  funded  by  the  National  Science 
Foundation.  The  objective  of  TI^S  is  to  identify  the  knowledge  pertinent  to  all  aspects  of  steel 
structures  and  to  malne  it  available  for  use.  The  knowledge  base  will  include  bibliographical 
material,  technical  data,  and  such  other  resources  as  research  in  progress,  case  studies,  and  the 
particulars  about  major  projects..  Professcnr  Lynn  S.  Bcedle,  Civil  Engineering  Departmait,  and 
the  author  are  principal  investigators  for  the  project  TICSS  faculty  and  students  come  fix)m  both 
the  College  of  Education  and  the  College  of  Engineering  and  Applied  Science,  and  work  jointly  to 
develc^  and  test  applicaticms  of  technology  which  will  facilitJtte  access  by  both  students  and 
practicing  engineers  to  state-of-the-art  information  in  a  variety  of  forms. 

Planning  TICSS:  Selecting  Appropriate  Hardware 

Plannmg  decisions  during  the  first  year  of  the  TICSS  project  dealt  with  determining  the 
scqpe  of  informaticm  to  be  collected,  and  identifying  the  suitable  hardware  and  software 
envircmment  MS-DOS  microcomputers  were  selected  because  most  professional  engineers  used 
this  system  and  TICSS  was  conceived  as  a  distributed  rather  than  centralized  information  system. 

Software  Selei^tion;  Turbo  Prolog  as  the  Programm!ng  Environment 

Turbo  Prolog  (Boriand,  1986)  was  selected  as  the  programming  language  in  which  the 
initial  information  subsystems  would  be  developed  Prolog  (finom  PROgramming  in  LOGic)  is  a 
COTiputer  language  based  oa  a  description  of  human  reasoning  in  terms  of  formal  logic.  While 
most  programming  languages  solve  problems  using  procedures  which  prescribe  how  to  solve  the 
problem,  Prolog  uses  statements  describing  objects  and  the  logical  rehtioiis  between  them  (in  the 
formoffaslL^HdSS)  to  describe  j^vhatAe  problem  is*  The  logical  statements  are  interpreted  by 
the  computer  as  programs. 

Turbo  Prolog  was  selected  as  the  programming  environment  to  take  advantage  of  its 
advertised  built-in  capacities  for  creating  and  manipulating  relational  data  bases.  In  addition,  the 
information  system  could  be  extended  by  addmg  more  facts  and  inferential  rules  to  the  Prolog 
program.  I>evelq)ment  of  a  knowledge-based  system  would  thorefore  involve  an  evolutiai  of  the 
existing  system,  rather  than  starting  over  in  a  new  environment,  with  the  associated  problems  of 
converting  data  fixHn  one  for  mt  to  another.  This  decision  has  proved  to  have  a  major  impact  on 
the  direction  and  rate  of  progJ^ess  of  the  TICSS  project. 

Development  of  ^  Computer-Based  Bibliographic  Data  Base 

As  a  first  step  in  developing  an  intelligent  data  base,  a  computer-manipulable  information 
base  of  bibliographic  information  and  other  reference  information  on  steel  sauctures  has  been 
designed  and  is  now  nearing  completion.  Materials  for  the  information  base  were  obtained  from 
existing  hard  copy  ?md  machine-readable  information  bases  currentiy  in  tfie  librsuy  of  Lehigh's 
Fritz  Engineering  laboratory,  from  oib^  sources  at  Lehigh  University,  and  from  tfie  American 
Institute  for  Steel  Construction  (AISC). 

As  noted  above,  tfie  bibUojgraphic  system  was  dtesigned  in  such  a  way  that  it  could  become 
part  of  a  comprehensive  knowledge-based  system.  The  system  also  was  designed  for  later 
conversion  to  optical-disc  storage  media  (CD/ROM,  CD-I,  or  otfier  formats  as  tfiey  become 
available). 
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Description  of  the  Bibliographic  Data  Base 

The  TICSS  bibliographic  data  base  was  designed  to  accomodate  information  on  fourteoi 
different  Qfpes  of  documents  with  a  total  of  35  fields.  The  system  uses  screen  templates  to  guide 
data  entry,  and  was  designed  to  be  vei/  flexible.  Far  example,  the  bibliographic  data  base  was 
designed  to  accooMxlate  documents  witl^any  number  of  authors  or  e<fitOTs;  it  permitted  the  entry  of 
any  number  of  keywords;  and  absttacts  and  comments  could  be  of  any  lengA.  As  noted 
previously,  the  original  version  of  the  Wbliogn^hic  system  was  designed  to  utilia  the  built-in 
relational  data  base  capabilities  of  Turbo  Prolog;  thus,  the  information  was  stored  in  sixteen 
separate  files. 

A  prototype  of  the  relati(xial  data  base  was  developed  and  tested  during   j  spring  and 
summer  of  1987,  and  the  prc>gram  is  now  being  extensively  revised  based  on  the  experiences  with 
the  protoQrpc.  The  following  section  will  discuss  the  positive  and  negative  outcomes  of  experience 
with  the  prototjpc,  and  describe  how  plans  for  the  development  of  future  TICSS  information 
systems  were  nxxlified  bas-Td  on  that  experience. 

Lessons  Gained  trom  Experience  with  the  Prototype 

Programming  in  logic  rather  (ban  in  procedures  was  a  very  different  experience  and  proved 
challenging.  Programmers  had  to  get  used  to  the  different  way  in  which  problems  had  to  be 
c(Miceptualized  in  designing  a  Prolog  prognun.  Once  this  cognitive  shift  was  accomplished, 
bo'v  iivcr,  the  programming;  expertise  gained  proved  valuable  in  planning  and  designing  the  expert 
syoicm  to  be  developed  as  the  next  phase  of  the  TICSS  project 

Although  Prolog  is  a  very  efficient  environmont  for  describing  aad  programming  facts  and 
lo^cal  relationships,  sonae  prograr.  jning  tasks  which  are  straig^itforward  in  othci-  programming 
languages  turned  out  to  be  cumbersome  in  Prolog.  Programming  data  entry  screens,  for  example, 
took  mudi  IcMiger  than  anticipated.  This  situation  was  inaproved  consi^rably  when  the  Turbo 
Protog  Toolbox  (Borland,  1987)  became  available  in  late  Spring,  1987.  The  Toolbox  consists  of 
an  extensive'set  of  utilities  to  facilitate  the  development  of  procolmcs  for  user  input,  screen  design 
and  layout,  menus,  graphics,  comrnunication  with  remote  devices,  and  conversion  of  data  fixm 
other  systems.  Extensive  use  of  the  Turbo  Toolbox  procedures  is  being  made  in  revising  the 
bibliog^phic  data  base  program. 

Prolog  is  a  list-oriented  language,  so  project  programmers  were  able  to  capitalize  on  their 
previous  expertise  with  other  list-oriented  languages.  Designing  the  data  structure  as  lists  and  lists 
of  lists,  and  developing  programs  to  manipulate  those  lists,  was  therefore  a  relatively 
straightforward  task. 

A  major  disappointment  was  the  speed  with  which  the  Turbo  Prolog  program  was  able  to 
cany  out  data  access  and  retrieval  by  means  of  its  built-in  relational  data  base  procedures.  Turbo 
Prolog  is  a,coirq)iled  language,  and  executes  programs  as  machine  language.  However,  even  with 
a  small  number  of  lecords  (approximately  twenty  in  the  original  prototype  version),  writing  to  files 
during  data  entry  v/as  very  slow,  and  search  and  retrieval  processes  seemed  to  take  forever. 

It  was  clear  that,  with  the  approach  taken  with  the  prototype  software,  Turbo  Prolog  would 
not  be  able  to  meet  project  needs,  lliorough  review  and  analysis  of  the  prototype  program  and  the 
design  specincaticMis  of  the  bibliographic  data  base  were  then  undertaken.  Options  considered 
included  chwging  completely  to  a  commercial  relational  data  base  manager  such  as  DBASE  m, 
changing  to  a  more  powerful  hardware  environment  which  would  support  the  use  of  more 
powerful  versions  of  Prolog,  and  re-designihg  the  program  within  the  Turbo  Prolog  environment 
The  latter  alternative  was  ^dged  to  best  meet  project  needs,  and  a  totally  redesigned  and  rewritten 
version  of  the  bibliopnphic  data  entry  p^gram  is  now  nearing  completion.  The  new  version  uses 
one  large  ASC3I  archival  file  instead  of  niultiple  relational  files  for  data  storage,  and  makes 
extensive  use  of  index  files  and  search  algorithms  developed  by  project  progranmiers  to  provide 
fast  and  efficient  Boolean  searcliing  of  the  archival  file.  Turbo  Toolbox  procedures  for  screen 
maragcmsnt  are  being  extended  to  provide  a  fiiendlier  user  interface. 
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Impact  on  the  Future  Direction  of  the  Project 

As  a  result  of  the  experience  with  Ae  Turbo  Rolog  prototype,  we  are  exploring  the  use  of  a 
variety  of  envirwimcnts  for  development  of  additional  infonnation  subsystems  for  TICSS.  For 
cxtunplc,  a  data  base  of  computer  software  for  engineering  applications  and  a  mechanism  for 
idcntfiying  current  research  will  bb  developed  in  DBASE  in+  and  procedures  for  converting 
DBASE  in+  data  into  a  forai  conapatiblc  with  the  Prolog  inforaiation  system  will  be  developed.  A 
change  of  both  hardware  and  sofi^are  envinwunents  is  actively  being  considered  since  the 
e)q)eriencc  of  the  project  has  demonstrated  that  the  original  enviroiunent  is  probably  too  limited  to 
meet  the  needs  of  the  Technical  Liformatidn  Center  for  Steel  Stmctuies. 

Future  Project  Activities 

Objectives  for  the  second  year  of  the  project  arc  to  test  the  extensively  revised  bibliographic 
data  case  with  a  variety  of  users,  and  to  expand  the  range  and  usefutaess  of  the  data  base  both  by 
entering  additional  bibliographic  information  and  by  extending  Ae  ran^  of  types  of  information 
which  will  be  included.  EveiXiUally  the  full  knowledge  base  could  include  information  on 
"documents"  of  the  following  types: 

•  bibliographies  (reports,  theses,  journal  articles,  books,  and  design  guides) 
«  technical  data 

•  case  studies,  (and  digests) 

•  current  research  activities 

•  slides 

•  inventcny  of  "large  stmctures" 
«  project  descriptions 

•  directory  of  professional  specialists 

•  con?)utersoflwarc 

•  films 

•  audio- and  videotapes 

•  research  rcsults* 

At  the  same  time,  the  incorporation  of  all  data  bases  into  true  knowledge-based  systems 
will  be  explored  Approaches  now  being  considered  for  combining  traditional  data  base 
management  system  c£5)abilities  with  the  power  of  kiK)wledge-based  systems  are  illustrated  in 
Figure  2  (see  following  page)»  These  include: 

•  Adopting  or  developing  a  system  in  which  the  capaHlities  of  the  data  base  management 

system  (DBMS)  are  included  within  a  knowledge-based  system  (KBS); 

•  A  system  wherein  the  KBS  accesses  the  DBMS  after  a  search  query  has  been  formulated, 

that  is,  where  the  KBS  acts  as  an  "intelligent  fiont  erd"  to  the  DBMS; 

•  Utiliang  an  oversight  management  system  which  accesses  both  the  KBS  and  the  DBMS 

as  appropriate  and  coordinates  the  exchange  of  information  between  the  two  systems. 

During  the  second  year  of  the  project  a  plan  for  converting  tlie  system  to  optical  disc 
(GD/ROM)  storage  will  be  developed^  In  addition,  a  variety  of  research  projects  are  now  being 
planned  to  support  these  efforts. 

Objectives  for  the  third  year  are  to  continue  to  expand  the  scope  and  contents  6£  the  system 
and  to  conrplete  the  deve^ppment  of  the  system  for  steady-state  operation,  to  complete  conversion 
to  optical  disc  format,  and  to  implement  a  marketing  plan. 
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Figure  2 

Design  Approaches  for  Intelligent  Data  Base  Systems 


1.  Include  Data  Base  Management  System  (DBMS) 
Capabilities  within  Knowledge-Based  System  (KBS) 
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Knowledge-Based  System  acts  as  "Intelligent 
Front  End**  to  Data  Base  Management  System 


Knowledge- 
Based 
System 


Data  Base 
Management 
System 


3.  Use  of  Oversight  Management  Program  To  Control 
and  CoordLiate  Access  to  and  Between  Knowledge-Based 
System  and  Data  Base  Management  System 
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Potential  Research  Questions  Concerning  ^^Intelligent"  Information  Systems 
The  advent  of  new  systems  of  information  access  opens  up  a  wide  range  of  research 
questions  related  to  the  representation  and  utilization  of  knowledge.  The  following  list  of  potential 
research  questions  is  representative  but  by  no  means  exhaustive. 

•  A  comparison  of  the  relative  effectiveness  of  represaiting  knowledge  to  the  user  in 

different  ways,  for  example  by  the  use  of  icons  compared  witfi  menus,  or  graphically 
compared  with  tabular  data; 

•  Identification  of  more  effective  ways  to  make  use  of  the  expertise  of  the  professional 

expert  who  is  intimately  familiar  witii  the  information  in  tiie  system  and  who  knows 
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how  to  apply  given  criteria  to  select  appropriate  subsets  of  the  information  system. 
Translating  the  insights  of  such  an  expert  to  a  set  of  instructions  in  a  computer  program 
is  a  major  ccraponent  of  the  development  of  a  knowl^ge-based  system. 

•  Investigation  of  how  people  develop  and  utilize  higjier-level  search  strategies.  For 

exan^lc,  strategics  which  utilize  Boolean  logic  rules  (intersection,  union,  negation)  and 
canbinations  of  Boolean  rules  (for  exanq)le,  metal  fetiguc  AND  welding  techniques 
BUT  NOT  bridges)  to  select  appropriate  informaticwi  ftom  a  large  data  base. 

•  Diffirences  in  cognitive  style  and  information  processing  techniques  utiilized  by  people 

when  woiidng  with  wnaputer-based  (on-screen)  information  compared  to  traditional 
print  materials. 

Summary 

This  paper  has  described  the  ongoing  development  of  a  project  through  which  information 
can  be  more  thoroughly  comprehended  and  more  properly  utilized  through  the  application  of 
artificial  intelligaice  techniques.  The  project  illustrates  one  way  in  which  artificial  intelligence  can 
be  applied  effectively  to  problems  of  the  real  world. 

Instructional  developers  and  researchers  in  educational  technology,  as  well  as  all  educators, 
face  tiic  problcnas  caused    an  explosion  of  information  related  to  tiieir  profession.  The  advent  of 
new  systems  of  informatiai  access  opens  up  a  wide  range  of  research  questions  related  to  tiie 
representation  and  utilization  of  knowledge.  The  potwitial  effectiveness  of  emergmg  information 
systems  is  enormous.  Educational  researchers  can  play  a  central  role  in  helping  tiiese  systems  meet 
their  potential  by  providing  guidance  in  terms  of  thorough  and  valid  research  on  issues  related  to 
the  design  and  utilizaticMi  of  "intelligent"  information  systems.  Artificial  intelligence,  therefore, 
offers  new  opportunities  for  educational  research  at  the  same  time  if  offers  potential  support  in 
identifying  and  utilizing  professional  information.  We  appear  to  be  at  tiie  teginning  of  a  new  era, 
an  "Age  of  Information."  The  inq)lications  of  tiie  changes  tiiat  are  rapidly  taking  place  around  us 
have  not  been  fully  recognized.  The  investigation  of  how  professionals  access  and  make  use  of  the 
vastly  increased  amount  of  information  available  is  a  fruitfiil  area  of  smdy. 
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ABSTOCT 


The  application  of  theory  to  the  design  of  computer-based  Instruction  (CBi)  has 
been  problematic  due  to  missing  substantive  linkages  between  that  theory  and 
CBI  development.  A  match  between  student's  cognitive  characteristics  and  the 
teaming  transaction  may  enhance  leamer  satisfaction,  reduce  time  on  task  and 
maximize  learning.  One  body  of  theory  that  promises  a  significant  Impact  on 
CBI  devetopment  Is  that  of  cognitive  styles.  Greater  effk^iendes  in  student 
leaming  may  be  obtained  by  matching  the  IndivMuars  cognltlye  style  with 
Instructlor^al  presentations  designed  to  enhance  that  cognitive  processing.  An 
important  question  to  address  is  how  to  design  the  courseware  and  which 
cognitive  style  theory  to  emptoy. 


The  computer  has  been  used  for  (he  delivery  of  educational  courseware  for  the 
last  twenty  years,  but  comparisons  between  computer-based  Instruction  and 
other  forms  of  instruction  have  demcnstrated  essentially  no  difference  In 
achievement  between  the  delivery  systems  (Clark  1982).  Why  Is  there  no 
difference  giver!  the  potential  fOr  Indivkiuallzation  within  the  teaming 
transaction?  Perhaps  the  answer  lies  In  the  design  of  the  computer  courseware 
Itself  and  not  in  the  technology.  The  problem  to  be  Investigated  In  this  paper  Is; 
Can  computer-based  courseware  be  designed  to  address  specific  leamer 
characteristics  and  If  so,  on  which  leamer  characteristics  shouki  the  d^^slgner 
focus  and  how  can  those  characteristics  be  addressed  In  the  courseware? 
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Foundations 

Educators  strive  to  develop  instructional  material  and  presentation 
methodologies  that  are  more  effective  and  efficient  than  those  which  have  gone 
before.  Two  approaches  that  have  resulted  from  these  efforts  are  those  of 
mastery  learning  and  individualization  of  instruction.  These  two  complementary 
approaches  represent  attempts  to  address  the  goals  of  optimization  and  transfer 
of  learning.  Operationalizing  these  approaches  has  been  difficult  due  to  the 
many  uncontrollable  variables  and  individual  differences  commonly  found  in 
the  learning  situation.  We  know,  for  example,  that  indrvidualization  can 
enhance  learning  but  is  difficult  in  large  groups.  One  way  to.overcome  this 
difficulty  is  to  provide  indi  idual  delivery  programs  tailored  to  each  learner.  In 
this  way  the  instruction  is  delivered  to  each  individual  in  a  format  ihat  is  more 
easily  processed. 

Another  variable  that  is  difficult  to  provide  for  in  large  groups  is  sufficient  time  on 
task.  The  time  it  takes  any  given  learner  to  master  information  is  both  variable 
and  individual.  If  we  could  provide  for  theso  and  other  variables  across  a  range 
of  individual  differences,  then  perhaps  learning  time  could  be  reduced  and 
comprehension  enhanced.  Individual  tutorinj^.ior  all  learners  could  provide  for 
this  level  of  interaction  but  is  obviously  impractical.  The  klentification  of  salient 
individual  differences  and  their  application  to  instruction  in  a  flexible  format 
could  provide  this  level  of  interaction  for  every  learner. 

One  such  flexible  format,  computer-based  instruction  (OBI)  holds  great  promise 
for  the  optimization  and  transfer  of  learning.  The  computer  has  the  dynamic 
potential  to  perform  :nany  pedagogical  functions  such  as;  present  infonnation, 
focus  attention,  engage  the  learner  in  discussion,  lead  the  learner  to  the  concoct 
response,  provide  feedback,  branch  for  remediation  based  on  learner 
response,  allow  for  individual  differences,  test  for  mastery,  branch  from.pretest 
to  information  required,  present  moving  graphics,  show  real  time  action,  video 
etc..  Within  each  of  these  categories  more  potential  is  hidden,  and  the  number 
of  categories  that  could  be  addressed  are  limited  only  by  the  imagination. 
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Computer-BasQd  Instmction 

Computer-based  instruction,  unlike  traditional  instmctional  methodologies, 
offers  greater  control  of  many  previously  uncontrollable  variables.  For  example, 
the  computer  offers  control  of  the  leaming  environment,  almost  limitless 
adaptation  capabilities  and  a  full  range  of  audio  and  visual  inputs  and  outputs. 
The  leamer  characteristics  remain  the  same  in  both  traditional  instruction  and 
computer-based  instruction,  but  the  use  of  computers  in  education  can  allow 
greater  control  of  both  the  leaming  environment  and  instructional  presentation. 
Why  then  has  the  promise  of  CBI  gone  unfulfilled? 

Kulik's  iTieta-anaiysis  (1980)  found  computer-based  instruction  to  be  a  more 
effective  leaming  topi  than  all  clher  presentation  methodologies.  Claric 
(1982),however,  refutes  Kulik's  findings.  He  explains  that  most  of  the 
differences  in  p(>rformance  described  by  Kulik's  analysis  can  be  explained  by 
relative  differeisces  in  the  ampunts  of  planning  and  instructional  design  time 
devoted  to  the  competing  presentation  methodologies  in  the  studies  analyzed. 
The  findings  that  CBI  by  requires  more  t'me  to  design  and  develop  comes  as  no 
surprise.  And  while  we  concede  that  ths  application  of  the  systematic 
development  of  instruction  has  improved  the  quality  of  computer-based 
instruction,  any  presentation  methodology  may  benefit  from  that  same  process. 
However,  even  when  cou'^a  materials  are  identical,  the  computer  offers 
conditions  and  options  to  the  leamer  that  cannot  be  efficiently  applied  in  any 
other  presentation  methodology.  ^ 

The  lack  of  difference  in  performance  between  traditional  presentation 
methodologies  and  CBI  described  by  Clark  may  be  explained  by  the  fact  that 
critical  leaming  theory  is  not  being  systematically  applied  to  development  of 
computer-based  instruction  This  fact  suggests  that  until  such  leaming  theory  is 
more  cleariy  articulated  to  the  devetopers,  CBI  can  only  be  an  altemate 
presentation  media;  ;io  better  or  worse  than  those  compared  to  it.  Therefore  the 
potential  optimization  of  leaming  through  CBT  will  not  be  achieved.  What 
footers  are  involved  in  the  optimatization  of  instruction? 
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Optimizing  Instruction 

Optimal  Instruction  is  that  set  of  leaming  activities  which  minimizes  cognitive 
resistance  to  the  material  to  be  learned.  In  other  words,  optimal  Instruction  for 
one  learner  Is  not  optimal  for  different  leamers  with  different  sets  of  leaming 
characteristics,  (I.e..  different  cognitive  styles).  Attempts  to  maximize  learning 
have  focused  dr.  leamer  adaption,  mastery,  knowledge  structure,  and 
individualization. 

Learner  Adaptation 

Adapting  the  leamer  to  the  leaming  situation  in  order  to  maximize  performance 
shows  some  promise  /Snow.  1984).  However,  care  must  be  taken  In  this 
attempt  to  teach  leaming  strategies  rather  than  changing  the  presentation  . 
since  the  leamer  Is  not  necessarily  the  best  judge  of  instructional  method. 
Claric,  (1982)  found."evkience  in  ATI  (aptitude  by  treatment  interaction)  studies 
that  students  tend  tc  report  enjoying  the  Instructional  method  from  which  they 
leam  lea^."  Based  upon  this  Information  we  cannot  depend  on  the  student  to 
make  the  choice  of  a  presentation  methodology  that  will  maximize  their  leaming 
and  transfer.  A  better  approach,  perhaps,  would  be  to  modify  the  instructional 
presentation  to  match  with  the  leamors'  dominant  leaming  pattern.  The 
application  of  research  on  cognitive  style  to  the  leaming  task  via  the  computer 
offers  great  potential  for  the  maximization  of  leaming. 

Snow  (1984)  found  In  his  study  of  Aptitude  by  Treatment  Interaction  (ATI)  that, 
"the  treatment  that  Is  mathemagenic  (I.e..  gives  birth  to  leaming)  for  one  kind  of 
leamer  appears  to  be  mathemathanic  (I.e..  gives  death  to  leaming)  for  another 
kind  of  learner,  and  vice  versa."  This  principle  rnakes  it  Increasingly  important 
that  the  mathemagenic  approach  be  Icientlfied  and  pursued.  Applications  of 
expert  systems  to  GBI  make  It  increasingly  possible  to  moM  Instructional 
presentations  to  leamer  characteristics.  This  study  will  attempt  tO  relate  some 
leamer  characteristics  to  specific  learning  principles,  thereby  laying  the 
groundwork  for  more  specific  application  of  these  principles. 

Mastery  Learning 

Each  Individual  Is  different  from  his  fellow  In  many  ways,  and  learning  Is  not  the 
lea^  of  these.  Bloom  (1968)  proposes  that  when  leamers  with  normally 
distributed  aptitudes  are  given  uniform  instruction  In  terms  of  quality  and  time, 
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their  achievemants  will  also  be  normally  distributed,  and  there  will  be  a  high 
correlation  between  apt'rtude  and  achievement.  However,  if  learners'  with 
normally  distributed  aptitudes  are  given  instruction  that  is  optimal  in  terms  of 
quality  and  required  leaming  time,  the  majority  of  leamers  could  be  expected  to 
achieve  mastery,  and  there  would  be  little  or    correlation  between  aptitude 
and  achievement. 

Bloom  assumes  that  time  Is  the  critical  factor  in  maximizing  leaming.  Time  on 
task,  however,  is  just  one  of  many  factors  that  contribute  to  learning.  Bloom  also 
refers  to  'optimal  instruction'  which  he  defines  as  individualized  instruction. 
What  set  of  characteristics  or  traits  should  the  instruction  reflect? 

Structure  of  Knowledge 

Gardner  (1983)  and  Sternberg  (1985)  point  out  that  leaming  is  based  upon  two 
components:  the  learner  and  the  material  to  be  learned.  F  osner  (1978) 
suggests  that  the  structure  of  knowledge  itself  affects  the  'storage,  retrieval,  and 
utilization  of  knowledge'  and  that  'previous  experience  and  existing  knowledge 
affect  perception,  communication,  leaming  and  performance  of  tasks.'  Reif  and 
Heller  (1982)  suggest  that  in  the  teaching  of  physics,  'considerable  attention  be 
paki  to  the  organization  of  the  knowlec^e  acquired  by  &!udents;  that  students 
be  taught  to  structure  their  knowledge  in  hierarchical  form;  and  that  such 
knowledge  be  accompanied  by  explk^  application  guidelines.'  These 
recommendations  were  based  upon  research  in  the  teaching  of  physics.but 
have  implications  for  other  quantitative  sciences,  as  well. 

To  accomplish  this  effectively,  a  serious  re-examination  and  synthesis  of  the 
prindples  of  human  cognition  as  they  apply  to  the  design  of  instruction  for  this 
medium  is  required.  To  accomplish  this  we  must  establish  the  existence  of 
differences  among  various  cognitive  styles  in  the  processing  of  information. 

Individual  Differences 

The  most  important  variable  to  be  considered  in  the  leaming  transaction  is  t\  e 
learner.  He  brings  a  unique  paci^ge  of  concepts,  precepts  and  experience  to 
the  leaming  situation.  This  uniqueness  has  been  referred  to  by  many 
researchers  as  individual  differences.  Individual  differences  are  many  and 
varied.  Those  differences  which  facilitate  or  impair  leaming  are  critical  but  often 
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ignored  in  the  If  aming  situation.  Group  instruction  will  often  present  the 
inff)rmation  in  a  manner  thought  to  ackiress  the  average  learner,  inteiiigence 
according  to  Gardner  is  not  as  simple  a  concept  as  the  number  on  an  I.Q.  test, 
he  postulates  different  inteliigences  by  conceptual  areas.  i.Q.,  of  course,  is  but 
one  individual  difference.  Cognitive  style  underlies  the  perception  and 
interpretation  of  the  learners  environment  and  perhaps  contributes  to 
intelligence.  These  intenrelationships  are  unclear  and  require  further  research. 
We  do  know,  however,  that  there  exist  a  set  of  measurable  cognitive  controls 
and  styles.  One  cognitive  style  that  has  been  well  established  and  researched 
will  form  the  basis  for  this  study. 

Learning  via  traditional  approaches  suffers  and  sometimes  benefits  from 
continuity  between  classes,  consistency  of  delivery,  consistency  of  content, 
interaction  between  students,  interaction  between  teacher  and  student,  and 
class  dynamics,  to  mention  a  few.  individualization  of  instruction  has  been 
introduced  to  exStiress  these  problems,  but  class  size  and  time  available  for 
instruction  reduce  rts  efficacy  in  the  classroom.  The  typical  approach  to 
individualization  has  often  baen  small  group  instruction  and  remediation. 

Approaches  that  focus  on  the  indi>^'du&lization  concepts  have  been  attempted 
in  the  print  medium  with  varying  success.  Here  the  problems  of  student 
motivation  and  pacing  impact  with  learning.  An  approach  that  is  ideal  for  one 
student  often  fails  with  another.  Attempts  to  remedy  this  problem  have  resulted 
in  multi-media  and  multi-methodological  approaches  in  which  a  student  may  be 
presented  with  as  many  instructional  formats  as  it  takes  to  achieve  mastery. 
Transfer  of  learning  in  enhanced  by  this  approach,  but  efficiency  of  learning  is 
not. 

Cognitive  Style  Constructs 

Studies  begun  in  the  early  nineteen  hundreds  applied  these  scientific  principles 
to  human  behavior  in  order  to  identify  differences  in  the  way  people  respond  to 
ranges  of  situational  variables.  Spearman  (1927),  Lewin,  Lippitt,  &  Whiie(1939) 
are  examples  of  this  movement.  The  outcome  of  these  eariy  studies  began  to 
show  that  individuals  did  in  fact  process  or  perceive  there  environments 
differentially.  Eariy  thought  centered  around  the  identification  of  traits,  abilities 
and  attitudes,  in  order  to  answer  questions  related  to  these  tra'rts,  abilities  and 
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attitudes,  they  soon  branched  into  studies  of  why  there  was  a  differetice  in 
processing  environmental  infonnation  to  the  identification  of  some  of  those 
differences.  The  construct  of  cognitive  style  was  hypothesized  to  identify  these 
differences  in  perception  of  environmental  stimuli.  Rather  than  explaining  those 
differences  in  perception,  the  concept  of  cognitive  style  describes  those 
differences.  However,  no  adequate  integration  of  the  many  cognitive  styles, 
cognitive  controls  and  individual  differences  has  been  accomplished  to  date. 
This  fact  does  not  degrade  the  concept  that  research  into  the  sep&rate  cognitive 
styles  can  buiki  upon  the  past  research  in  a  particular  cognitive  style.  There  is 
however  somt?  commonality  between  certain  of  the  concepts. 

That  individuals  have  a  collection  of  innate  traits  and  abilities  that  mediate 
interpretation  of  stimuli  is  well  established.  They  also  learn  strategies, 
programs  or  transformation  operations  to  translate  objective  stimuli  into 
meaningful  dimensions  (Bieri,  1 971 ).  Cognitive  styles  are  therefore  defined  in 
temis  of  "consistent  pattems  of  organizing  and  processing  information  that 
mediate  between  environmental  input  and  the  organism's  output"  (Messick, 
1976)  and  "organize  behavior  as  we!!  as  input "  (Zajonc,  1968). 

Raid  Dependence/Independence  Dimension 

Messick  (1970)  has  summarized  woric  in  cognitive  styles  into  nine  categories. 
Many  conceptual  differences  between  and  among  the  categories  exist.  No 
attempt  as  yet  has  integrated  the  cognitive  styles  into  an  information  processing 
model,  so  we  are  left  with  t!ie  separate  concepts  of  cognitive  styles  that  may  be 
applied  in  teaming  presentations. 

Thompson  (1979)  found  that  the  cognitive  style  of  fieki  dependence/  field 
independence  was  directly  related  to  learning  achievement.  It  is  also  this 
concept  that  has  been  most  extensively  studied.  This  dimension  of  cognitive 
style,  offers  considerable  evidence  concerning  the  processing  of  information 
which  is  applicable  to  the  computer-based  instruction  environment.  The  field 
dependence/independence  concept  is  described  by  Witkin  as  being  bipolar. 
"At  one  extreme  of  the  performance  range  perception  is  strongly  dominated  by 
the  prevailing  fieki  (fieki  dependence)"  and  "at  the  other  extreme,  where  the 
person  experiences  items  as  more  or  less  separate  from  the  surrounding  field, 
the  designation  'fiekJ  independent'  was  used,"  (Witkin,  Moore,  &  Goodenough, 


1977).  The  dimension  described  by  Witkin  was  first  identified  in  the 
investigation  of  perception,  and  it  was  further  defined  as  having  educational 
application.  "Extensive  evidence,  accumulated  over  the  years,  shows  that  the 
styles  we  first  identified  in  perception  manifest  themselves  with  symbolic 
representations,  as  in  thinking  and  problem  solving."  (Witkin,  1977,).  When 
Witkin  found  that  the  perceptual  tasks  he  identified  as  fieki 
dependent/independent  were  related  to  non-perceptual  intellectual  tasks,  the 
underlying  construct  was  broadened  to  a  "global-articulated"  dimension.  The 
fieM-independent  person  prefers  to  approach  the  environment  in  analytical 
terms  as  opposed  to  a  preference  for  experiencing  events  globally  in  an 
undifferentiated  fashion.  Witkin  (1977)  relates  that: 

"Studies  of  the  role  of  cognitive  style  in  student  learning  have  used  both  the 
cognitive  and  social  characteristics  constituent  in  the  articulated-global 
dimension  to  conceptualize  relations  between  learning  behavior  and  cognitive 
style.  Of  the  four  learning  areas  we  consider,  the  first  two  have  used  the  social 
characteristics  as  a  bridge  between  the  domains.  These  two  areas  are  learning 
of  social  material  and  the  effects  of  social  reinforcement.  The  third  and  fourth 
learning  areas  used  mainly  cognitive  characteristics  as  a  bridge.  These  are  the 
areas  of  mediating  mechanisms  in  learning  and  cue  saliance." 

Field  Independence 

The  field  independent  person  experiences  in  an  articulated  fashion  and  tends 
to  perceive  items  as  discrete  from  their  background  when  the  fiekj  is  organized, 
and  to  impose  structure  on  the  fieki,  and  so  to  perceive  it  as  organized  He/she 
is  generally  facile  on  tasks  requiring  differentiation  and  analysis,  whether  in 
identifying  the  presence  of  logical  enx)rs  or  in  understanding  the  point  of  a  joke. 
This  analytical  penchant  leads  to  a  high  degree  of  differentiation  of  the  self  from 
its  context  (Anderson,  Ball,  Murphy,  1975).  Witkin  (1977)  found  that,  "field 
independent  persons  are  more  likely  to  use  mediators,  of  their  own  design,  in 
dealing  with  a  learning  task.  ^ 

Field  Dependence 

Field  dependent  persons  are  more  likely  to  rely  on  characteristics  of  the 
learning  task  itself  "rather  than  create  mediators  and  that  has  a  tendency  to 
favor  a  spectator  over  an  hypothesis  te  sting  approach"  (Witkin,  et.al;  1977)  In 
contrast,  it  may  be  said  that,  "experience  is  more  global  when  it  accords  with  the 
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overall  character  of  the  prevailing  field  as  given,  and  involves  less  intervention 
of  mediators  such  as  analysis  and  structuring".  (Witkin,  1977). 

In  summary,  Witkin  found  that  performance  on  perceptual  tasks  was  related  to 
performance  on  non^rperceptual  tasks.  He  broadened  the  concept  to  an 
"articulated  global",  the  dimension  on  which  people  tend  to  stmcture  their 
perceptual  field.  The  components  that  delineate  the  concept  of  the  "articulated 
global"  dimension  are  the  need  for  social  reinforcement,  the  learning  of  social 
material,  importance  of  cue  salience,  and  mediation  in  problem  solving. 

It  is  proposed  that  a  marriage  between  CBI  design  components  and  cognitive 
structures  of  the  individual  utilizing  the  material  would  maximize  information 
transmittal  and  minimize  the  time  element  required  for  learning,  thereby  making 
instruction  more  efficient  and  effective.  The  question  remaining,  however,  is 
that  of  how  to  operaticnalize  those  cognitive  constructs  in  the  FD/FI  cognitive 
style. 

Qperationalizing  Cognitive  Components 

In  order  to  utilize  the  components  of  a  particular  cognitive  style  in  the  design  of 
Instruction,  the  significant  components  must  be  identified.  Once  identified, 
oon^esponding  treatments  must  be  devised. 

Many  FD/FI  characteristics  have  been  identified  in  the  literature,  but  only  those 
characteristics  identified  by  Witkin  (1977)  and  Renninger  (1983)  as  having 
educational  implications  were  considered  in  the  development  of  the  lesson  to  be 
used  in  this  study.  Instructional  strategies  were  then  applied  to  these  cognitive 
style  learrier  characteristics.  For  example,  the  Reki  Dependent  loamer, 
according  to  Witkin  (et.  al.  1977),  has  the  follov\nng  characteristics/requirements; 

0  an  interpersonal  orientation, 

0  extrinsic  motivation, 

0  reinforcement, 

0  social  cues, 

0  help  sequences, 

0  structure, 

0  goals, 

0  feedback,  and 

0  salient  relevant  cues. 
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The  concept  of  FD/Fi  is  bi-polar,  therefore,  the  opposite  characteristics  apply  to 
the  Field  Independent  learner  Instmctional  strategies  were  then  matched  with 
these  learning  characteristics  to  create  the  treatment  lesson.  The  two 
treatments  or  branches  are  characterized  by  the  inclusion  or  exclusion  of  these 
instructionaf  strategies  while  keeping  the  content  constant. 


In  order  to  guide  the  development  of  the  two  treatments  a  design  matrix  was 
developed.  The  following  matrix  groups  the  cognitive  characteristics  into 
categories  according  to  their  similarities  and  identifies  those  strategies  believed 
by  the  author  to  address  those  cognitive  characteristics.  The  lesson  material  for 
each  branch  was  then  constructed  to  reflect  these  instructional  strategies. 

(FIflura  1) 

OOONmVE  STYLE  UARMNQ 
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The  design  of  any  courseware  is  a /creative  endeavorand  design  approaches 
differ  dramatically.  To  illustrate  one  approach  in  an  attempt  to  operationalize  the 
cognitive  constructs  of  field  dependence  and  field  independence,  the  author 
has  chosen  a  lesson  in  Thermodynamics  Two  branches  were  created,  one  for 
each  of  the  cognitive  styles  represented  in  the  design  matrix.  The  field 
dependent  branch  most  closely  resembles  what  can  be  considered  the 
traditional,  spectator  approach  to  CBI  design.  Objectives  are  stated  early  in  the 
lesson,  content  presented  in  graphic  and  text  and  finally  questions 
presented.with  personalized,  error  related  feedback.  Help  is  always  available. 
The  field  independent  path  represents  an  hypothesis  testing  approach  to  CBI 
design.  Features  In  this  path  include  broad  goals  instead  of  spedfic  objectives, 
right/wrong  feedback  wh^hout  further  cues,  and  a  discovery  approach  to 
interacting  with  the  materials.  Help  is  available  only  at  the  beginning  of  this 
branch. 
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Ihe  Effects  of  Selected  CAI  Design  Strstesie*  on  Acblerenent: 
and  an  Exploration  of  Other  Related  Factors 

Researchers  have  demonstrated  that  programmed  instruction  methods,  using 
both  computer  and  print  technologies,  can  increase  learning  in  many  content 
areas  and  populations  (Hannafin,  1985).    It  is  apparent  that  good  computer 
programs  help  learners  learn.    However,  researchers  must  isolate  variables 
systematically,  and  examine  their  effectiveness,  in  order  to  improve  the  design 
of  computer-assisted  instruction.    The  CAI  design  strategies  under  investigation 
in  this  study  were  type  of  control  (internal  vs.  external)  and  feedback 

tiro^M^^  r*  r'       feedback).    In  internally  cont tolled  CAI  programs, 

cne  option  to  select  c  branch  is  decided  by  the  person  using  the  program.  In 
externally  controlled  programs,  branches  a^e  selected  for  the  learner,  based  on 
responses  to  embedded  questions. 

In  addition,  educators  have  speculated  that  personality  characteristics  can 
either  interfere  with  or  enhance  learning  by  computers  (Eisele,  1984).  For 
example,  Maurer  and  Simonson  .( 1984)  contended  that  computer  anxiety  can 
interfere  with  computer-based  learning.    Thus,  the  purpose  of  this  study  is  not 
only  to  determine  the  effects  of  type  of  control  and  feedback  on  learning 
acquisition,  but  also  to  explore  the  influence  of  such  facfcors  as  computer 
anxiety,  self-concept,  learning  style,  and  gender  on  achievement,  as  well  as  to 
study  how  these  factors  correlate  with  each  other. 

Hazen  (1985)  declared  that  both  learner  control  over  CAI  choices  and  non- 
threatening,  positive  feedback  can  keep  learners  motivated  when  working  through 
CAI  programs.    The  question  is  do  these  strategies  aid  learning? 

Control  Strategies 

One  of  the  more  interesting  issues  in  the  area  of  computer-assisted 
instruction  is  the  control  of  the  instruction  and  where  it  should  be  placed. 
Internal-control  strategies  put  the  learner  in  charge  of  the  instruction. 
Bcteml  control  allows  some  inLaraction  between  the  instructional  program  and 
the     arner,  but  ultimately  the  program  determines  che  "path"  through  the 
instruction. 

Research  has  been  conducted  which  compares  the  effectiveness  of  internal- 
control  strategies  to  external-control  strategies.    Sasscer  and  Moore  (1984) 
asserted  that  "the  research  literature  related  to  learner  control  of  instruction 
is  characterized  by  reports  of  contradictory  findings  and  equivocal  terminology" 
VP»  28). 

Since  learner  control  usually  means  that  the  individual  is  allowed  to  stiect 
options  for  additional  or  enhanced  instruction,  the  research  by  Tobias  (1984) 
has  important  implications.    Treatments  in  Tobias'  study  offered  students  a 
choice  of  Internal  or  external  control.    Findings  suggested  that  even  if 
students'  selection  of  options  was  "frequently  not  wise  or  Informed  the  mere 
^election  of  a  control  strategy  increased  cognitive  processing  and  thus 
achievement  was  increased"  (p.  8).    When  learner  control  and  external  control 
were  more  directly  compared  by  Laurillard  '1984) ,  the  conclusion  was  that 
students  elect  to  branch  when  given  that  option  and  in  such  a  variety  of  ways 
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that  "program  control  must  seriously  constrain  the  Individual  preferences  of 
students"  (p.  14).    Additional  research  by  Stevens  (1984)  suggested  that  greater 
amounts  of  lea-..ner  control  Increased  learning. 

In  contrast  to  research  findings  which  favor  the  use  of  Internal-control 
strategies,  there  Is  evidence  that  external  control  mry  better  serve  learners* 
needs.    Belland.  Taylor.  Canelos.  Dwyer  and  Baker  (1985)  found  that  external 
pacing  reculted  In  somewhat  higher  achievement  than  Internal  pacing.  These 
findings  were  confirmed  In  studies  by  Dwyer.  Taylor.  Canelos.  Belland  and  Baker 
(1985)  and  Canelos.  Baker.  Taylor.  Belland  and  Dwyer  (1985).    These  findings 

SSr^rSi^ J"?^"  rfK*''*'^''^  McUughlln  and  Malaby  (1974).    When  students 
were  permitted  to  work  through  units  at  their  own  pace,  they  completed  fewer 

units  than  did  students  who  were  directed  to  complete  a  specific  number  of  units 
per 

Some  support  also  has  surfaced  for  an  approach  which  advises  the  student 
about  branching  decisions.    However,  this  Is  almost  a  form  of  external  control, 
since  the  computer  program  does  Influence  decisions.    Research  by  Tennyson  and 
Buttrey  (1980)  and  Tennyson.  Tennyson  and  Rothen  (1980)  found  this  adaptive  or 
advisement  strategy  to  be  Siperlor  to.  both  external  and  Internal  control  In 
computerized  Instruction. 

Research  also  exists  that  shows  conflicting  results  for  type  of  control 
sj^ategy.    As  eaily  as  1979.  Msbee.  Nelmann  and  Upton  discovered  no  significant 
differences  betweea  self^paced  (Internal  control)  and  instructor-paced  (external 
control)  learning.    More  recently.  Goetzfrled  and  Ha.  naf In  (l?85a.  1985b)  found 
no  significant  differences  between  groups  utilizing  Iwternal-control:  external- 
control  and  linear  (no  control)  CAI  programs.    This  supported  the  earlier  non- 
significant findings  of  Dunn  (1971).  who  examined  review  strategies  which  were 
either  internally  or  externally  contTolled.    One  reason  for  the  lack  of 
/ifofx  differences  in  these  studies  was  suggested  by  Garhart  and  Hannafin 

U986).  who  concluded  "that  learnern  are  not  good  judges  of  H"»lr  eh  route 
comprehension"  (p.  12). 

Feiedback 

For  most  of  this  century,  it  has  been  stated  that  frequently  administered 
feedback  aids  learning  (Pressey.  1926;  Skinner.  1954).    However,  many 
researchers  have  found  that  knowledge  of  results  and  reviews  have  not  had  a 
significant  effect  on  learning  acquisition  (Cohen.  1985;  Hunn.  1971;  Oilman. 
11)69)  i  although  other  studies  hi  j  found  certain  feedback  strategies  to  be 
effective  (Kulhavy.  1977,  I'ennyson  &  Buttrey.  1980).    For  example.  Oilman  (1969) 
reported  that  varying  how  content  was  presented  worked  better  than  did 
repetition  to  improve  learning,  after  incorrect  responses  were  made. 

Sassenrath  (1975)  reported  that  delayed  feedback  was  superior  to  immediate 
feedback  generally,  although  Joseph  and  Maguire  (1982)  expressed  doubt  about  the 
effectiveness  of  delayed  over  immediate  feedback,  after  studying  this  variable 
in  a  variety  of  learning  situations.    FurLaermore .  when  Modes  (1984-1985) 
compared  the  effects  on  lejirnirig  of  corrective  feedback  (i.e.,  encouraging 
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students  to  make  further  atteapts  to  give  the  right  answer)  and  noncorrective 
feedback  (I.e.,  not  encouraging  and  even  discouraging  students  to  nake  the 
correct  response),  no  statistically  significant  differences  were  found. 

IndlTldoal  Difference  Variables 

Computerphobla  has  been  defined  as  the  resistence  to  the  subject  of 
coBputers  and  avoidance  of  them,  as  well  as  fear,  anxiety  or  hostility  towards 
computers  (Jay,  1981;  Haurer  &  Slmonson,  1984).    This  condition  generally 
manifests  Itself  In  the  form  of  negative  statements  about  computers  and  their 
Wo^iffU'^^'^  *  Slmonson,  1984).    Researchers  have  demonstrated  that  people  who 
have  had  soae  experience  using  computers  have  more  positive  attitudes  towards 
them  than  do  Inexperienced  people  (Kullk,  Bangert  &  Williams,  1983;  Loyd  & 
Gressard,  1984;  Tyagl,  1984).    Jonassen  (1986),  however,  found  that  no 
relationship  existed  between  level  of  computer  experience  and  state  anxiety  when 
using  a  computer. 

According  to  Nercant  and  Sullivan  (1983)  and  Winkle  and  Hatthews  (1982), 
females  had  less  favorable  attitudes  towards  computers  than  did  males,  as  well 
«5  higher  levels  of  computer  anxiety.    Although  both  negative  attitudes  and  high 
anxiety  can  have  deleterious  effects  cn  learning,  neither  of  these  relationships 
has  been  Investigated  thoroughly.    Furthermore,  It  has  not  been  demonstrated 
conclusively  that  males  have  significantly  better  attitudes  towards  computers 
y!ta-,i°.     t^^^'  Gressard  (1984)  and  Swadener  and  H^nnafln 

U987)  found  no  significant  differences  statistically  when  Investigating  gender 
differences  and  attitudes  towards  computers. 

there  Is  some  evidence  to  suggest  that  a  positive  correlation  between  high 
self-concept  and  academic  achievement.  In  general,  exists  (Green,  1977). 
However,  the  relationship  between  self-concept  and  learning  from  CAT  programs 
has  not  been  thoroughly  explored.    Although  both  low-  and  high-achieving 
learners  can  benefit  from  CAT,  it  has  not  been  shown  that  self-esteem  can  be 
Improved  significantly  by  CAT  (Dalton  &  Hannafla,  1984),  or  even  that  those  with 
good  self-concepts  leari  bet tar  from  CAT  programs. 

Recent  Interest  in  researching  individual  differences  is  an  encouraging  sign 
for  education.    Hoffman  and  Waters  (1982)  stated  that  CAT  is  best  for 
individuals  "who  have  the  ability  to  quietly  concentrate,  are  able  to  pay 
attention  to  details,  have  an  affinity  for  memorizing  facts,  and  can  stay  with  a 
single  task  until  completion"  (p.  51).    Smith  (1985)  found  that  visually 
perceptive  students  achieved  better  In  a  CAT  presented  learning  task  than  did 
;the  nonvlsiioll'/  perceptive.    Kedberg  and  McNamara  (1985)  found  "that  the 
Interaction  of  feedback  with  cognitive  style  did  not  Improve  the  performance  of 
field  independent  subjects"  (p.  14).    In  fact,  field  Independent  subjects  were 
negatively  influenced  by  feedback.    Hanm  'in  (1985)  suggested  that  learners 
whose  locus  of  contirol  was  Internal  made  more,  accurate  and  effective 
instructional-control  decisions  than  learners  whose  locus  of  control  was 
'external . 

Learning  style  has  been  defined  In  a  number  of  ways,  which  Include  the 
learner's  preferences  for  a  number  of  instructional  techniques  (Rlstow  & 
Edeburn,  1983).    However,  as  pointed  out  by  Enochs  (1985),  learning  style 
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generally  Is  concerned  with  an  individual's  preferences  for  learning 
abstractions  or  more  concrete  information.    They  found  that  concrete  learners 
learned  more  from  CAI  than  did  more  abstract  learners.    Kolb  and  Baker  (1984) 
separated  learning  styles  into  two  continuums:    (1)  the  Active  Experimenta'-ion 
Reflective  Observation  continuiim,  and  (2)  the  Concrete  Experience,  Abstract 
Conceptualiiation  continuum.    It  is  perhaps  t'uese  learning  styles  which  may 
prove  to  increase  our  knowledge  of  how  individual  differences  interact  with 
instructional  techniques. 


Methodology 


Three  hundred  thirty-six  undergraduate  students  from  speech,  communications 
and  psychology  were  assigned  randomly  to  one  of  seven  grou,-..    There  were  more 
females  (60Z)  than  males  (40Z)  included  in  this  sample,  and  the  majority  (60Z) 
had  never  taken  a  computer  course.    Bach  of  the  CAI  treatments  was  designed  to 
include  one  or  more  of  the  independent  variables  under  investigation. 

The  content  of  the  CAI  programs  used  in  this  study  taught  objectives  for  a 
college-level  course  in  research.    The  content  dealt  with  definitions  and 
concepts  in  social-science  research,  including  defining,  stating  the  purposes  of 
and  discriminating  among  descriptive,  experimental  and  historical  research- 
dependent  and  independent  variables;  surveys  and  questionnaires:  and  types 'of 
sources.  ' 


The  seven  treatments  can  be  described  as  follows: 

1.    Linear  program.    There  were  no  embedded  questions  and  therefore  no 
feedback.    No  options  were  offered  to  the  subjects  and  therefore  no 
interaction  took  place.    Students  read  each  screen,  pressed  the 
return  key  and  read  ihe  next  screen  until  they  were  finished. 

2»    External  control  with  no  feedback.    Subjects  were  asked  questions 
about  the  content  at  certain  points  it  the  instruction.    If  they 
answered  th-   question  incorrectly,  they  were  recycled  through  the 
instruction  and  asked  the  question  aga.h.    This  group  saw  all  the 
screens  that  woultl  eventually  become  options  for  the  internal- 
control  ,group* 

3.    External  control  with  immediate  feedback.    Conditions  were  the  same 
18  for  treatment  #2,  with  immediat'  feedback  given  for  responses  to 
questions .    Feedback  screens  appeared  immediately  .tftor  subject's 
responses.  ' 

^'    External  contvol  with  da? ayed  feedback.    Conditions  were  the  same 
tor  treatment  §2:,  "Xth  delayed  feedback  given  for  responses  to 
embedded  questions.    Once  the  subjects  completed  the  CAI  prograr  , 
they  were  given  feedback  regarding  the  number  of  correct  responsep 
they  had  made  before  taking  the  post  test. 

5*  i»t:ernal  control  with  no  feedback.  Subjects  were  asked  questions 
at  certait.  points  in  the  instruction  before  they  were  offered  the 
opportunity  to  see  additional  i..8truction  or  co  review  what  r.hey 
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had  just  seen.    Upon  answering  a  question,  they  had  the  chance  to 
continue  or  to  go  back  and  see  the  Instruction  again  If  they 
answered  the  previous  question  Incorrectly. 

^*    Internal  control  with  lamedlate  feedback.    Conditions  were  the  same 
as  for  treatment  f5,  with  lamedlate  feedback  Included. 

^*    Internal  control  with  delayed  feedback.    Conditions  were  the  saue 
as  for  treatment  #5,  with  delayed  feedback  given. 

The  seven  treatments  were  assigned  randomly  to  the  seven  groups. 

«..V4^J*  collection  was  conducted  In  two  sessions.    The  first  session  Introduced 
subjects  to  the  purpose  of  the  research  and  a  number  of  tests  and 
questionnaires,  which  represented  a  number  or  additional  irarlables.  were 
administered.  • 

Tiie  first  of  these  variables  was  computerphobla,  measured  via  a  Llkert-type 
attitude  scale  developed  by  Haurer  and  Simonson  (1984).    The  secoud  variable  was 
seit-concept,  as  measured  by  the  Tennessee  Self-Concept  Scale  (Pitts,  1964).  An 
overall  self-esteem  score  was  determined  (l.e*.  Total  P  Score).    The  third 
variable  was  learning  style,  which  was  measured  by  the  McBer  and  Company 
Learning  Styxe  Inventory,  developed  by  Kolb  and  Baker  (1984).    Plnally,  a  short 
demographic  questionnaire  was  admlnlistered.    All  data  on  additional  variables 
were  collected  In  sessions  attended  by  30  to  70  subjects. 

The  second  data-collection  session  was  scheduled  to  take  place  in  a 
microcomputer  laboratory  with  each  subject,  who  had  to  work  individually.  The 
subject  was  given  the  CAT  program  assigned  to  his/her  fe.oup,  worked  through  the 
program,  and  then  took  a  post-test.    This  dependent  measure  was  a  15-ltem 
multiple-choice  test,  which  was  designed  to  measure  learning  from  the  CAT 
programs.    The  number  of  branches  that  ench  subject  elected  to  take  was  recorded 
by  the  computer. 

A  2x3  completely  rfiidomlzed  factorial  design,  with  fixed  effects,  with  a 
control  group  was  used  in  this  study.    The  Independent  variable.  Control,  had 
**'^Ji'^**  ::°^""'=«y'  Internal  control,  and  (2)  passive,  forced, 
external  control,    rhe  other  independent  variable,  Peedback,  had  three  levels: 
(1)  immediate,  (2)  delayad,  and  (3)  no  feedback.    The  control  group  received  a 
linear  program,  with  no  feedback  given.    Data  were  analyzed  using  ANOVA 
techniques  for t main  effects  and  interactions,  as  well  hb  Tukey-HSD  and 
correlational  procedures. 

Results 

Both  the  wlthln-cell  and  treatment-level  means  for  the  achievement  measure, 
as  well  as  the  number  of  subjects  under  each  condition,  are  shown  In  Table  I. 
The  analysis  of  variance  results  are  displayed  in  Table  2.    No  slgniflcaat 
differences  between  means  were  found  for  either  the  control  or  feedback 
Independent  v  rlable.    It  should  be  noted  that  the  linear,  no-feedback  control 
group  was  excluded  from  these  analyses.    However,  when  Tukey' s  HSD  test  was 
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employed  to  make  all  pairwlse  comparisons  among  the  levels  of  the  independent 
variables,  the  mean  of  the  control  group  was  included.    Although  the  control 
group  scorv"  most  poorly,  Tukey's  HSD  procedure  indicated  that  no  two  groups 
were  significantly  different  at  the  .O:  level. 

An  investigation  of  the  relationship  among  various  personality  and 
demographic  variables,  number  of  branches  taken  by  internal-control  subjects, 
and  achievement  scores  revealed  a  nunber  of  interesting  findings.    The  results 
of  ttia  correlational  analyses  appear  in  Table  3. 

m>>-i  al^^t^^  *^nx®"*^!  ^°       Significantly  more  computerphobic  than  were 

mazes  u-  .10}  and  not  to  have  taken  a  computer  course  (r  -  .21).  However, 

u?^^***"^  computerphobia  nor  lack  of  computer  coursewrk  were  correlated 
i^th  achiev^ent  scores.    Furthermore,  female  students  achieved  significantly 
higher  scores  than  did  the  males  in  the  study       «  .10).    It  also  was  determined 
that  students  who  had  taken  a  computer  course  had  more  positive  self-concects 
than  those  who  had  not  <£  -  .14). 

In  addition,  females  were  found  to  have  a  more  concrete  learning  style  (r  - 
.13),  hut  were  less  reflective  in  their  style  of  learning  ( r  -  -.10),  than 
males i    It  was  discovered  that  concrete  learners  were  nore  computerphobic  (r  - 
.13).    Furthermore,  internd-control .subjects  who  chose  to  select  branches  To 
wor^  through  had  higher  achievement  scores  than  did  students  who  did  not  branch 
as  frequently  (£  »  .33). 

Dlscassion 

Findings  of  no  significant  difference  necessitate  caution  in  drawing 
conclusions.    No  differences  were  uncovered  for  the  main  independent  variables. 
Control  or  Feedback.    With  the  simple,  verbal-information  learning  task  employed 
in  this  study,  subjects  seemed  to  be  able  to  learn  regardless  of  control 
strategy  or  method  of  feedback.    The  lack  of  significant  findings  for  the 
independent  variables  can  be  attributed  to  two  pot-sible  reasons.    First,  the 
greet  care  taken  to  design  seven  effective  CAI  programs  may  have  resulted  in  the 
development  of  instructional  programs  that  failed  to  maximize  experimental 
differences.    Second,  the  simplicity  of  the  learning  task  f^^r  these  subjects  may 
have  led  to  a  failure  to  show  differences  among  treatment  levels.  However, 
findings  of  no  significant  difference  are  common  in  CAI  research,  such  as  in  the 
study  by  Dal ton  and  Hannafin  (1984). 

A  number  of  additional  conclusions  were  drawn  based  on  data  analysis. 
Subjects  who  chose  to  branch  received  information  rhat  allowed  them  to  score 
higher  on  the  achievement  test  than  those  who  elected  not  to  branch  as 
frequently.    Although  females  ecored  higher  on  the  computerphobia  scale,  this 
did  not  interfere  with  their  performance  on  an  achievement  test,  after  they 
worked  through  a  CAI  program.    Could  it  be  chat  the  traditional  differences 
between  genders  on  such  subjects  as  mathematics  and  computers  is  no  longer  a 
major  factor?    More  concrete  learners  had  higher  computerphobia  scores.    Is  the 
activity  of  sitting  at  a  computer  keyboard  likely  to  raise  anxiet,  among  such 
learners?    There  may  be  a  need  for  more  research  in  such  areas  ••he 
:relationship  of  various  learning  styles  to  learning  from  CAI  and  other 
electronic  learning  aids. 
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Hore  research  needs  to  be  conducted  on  how  different  types  of  individuals 
learn  from  microcomputer,  and  about  how  to  make  computer  software  more  effective 
enhancers  of  learning.    Microcomputers  are  rapidly  becoming  oue  of  the  most 
important  media  of  instruction  in  our  schools  and  in  busines«  and  industry. 
Educators  and  trainers  must  be  ab^e  to  determine  the  best  ways  to  use 
microcomputers.    Learning  achievement  and  efficiency  can  be  increased  possibly 
by  the  right  combination  of  control  and  feedback  strategies.    With  this  in  mind 
a  number  of  recommendations  are  offered. 

1.    This  study  should  be  replicated  with  different  levels  of  learning 


I.    Different  populations  should  be  used  in  a  replication  of  this 
study. 

»•    An  examination  of  other  possible  correlational  variables,  or 
variables  which  represent  other  areas  of  individuals  differences 
(such  as  locus  of  control  and  cognitive  style),  should  be 
conducted • 

•    A  meta  analysis  of  CAT  research  should  be  conducted  to  bring 

together  111  findings  to  date  and  lead  to  more  recommendations  for 
designing  bettor  programs. 
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I!ible  1 


Aehl«TCMnt  and  Subject  Pteqoenciet  for  Control  mad  Feetf  «ck  Factors 

C4I  Program 


Control 

Feedback 

iBuiedlate            Delaytd  No 

Internal 

^3.19                 12.56  13.15 
<16)                  (18)  (13) 

External 

—  1 

12.40                 12.83  12.76 
<*0)                  (47)  (45) 

12.63                  12. i2.84 
<56)                   (65)  (58) 

12.94 

(47) 


12.67 
(132) 


Note:    The  number  of  subje    s  In  each  experimental  unit  Is  in  parentheses. 

All  Internal-control  subjects  who  branched  fewer  than  15  times  were 
excluded  from  this  analysis. 

The  Linear,  No-Feedback  Group  had  a  mean  of  12.26  and  had  42  subjects 
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Table  2 

Analysis  of  Variance  on  ikchJereMat  Scores  for  Control  and  Feedback  in  CAI 
Prograas 


Source  of  Variation 

df 

MS 

F 

Control 

1 

2,59 

.93 

Feedback 

2 

.29 

Control  X  Feedback 

2 

3.54 

1.27 

Residual 

173 

.  2.78 
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TmhU  3 


Correlations  imong  Personality  and  DeMgraphic  Factors,  Branchlngt  and 
Achleraient  Scores  u^t  «-« 


Computer  Computer- 
Achievement  Course  phobia  Gendet 


Factor 


Gender  ^10* 

Computer phobia  ,03 

Self-Concept  ,04 

Learning  Style  .09 
(Concrete  Experler4ce) 

Learning  style  ^,07 
(Reflective  Observation) 

Learning  style  ,03 
(Abstract  Concept- 
ualization) 

Learning  style  -,02 
(Active  Experimentation) 

Branching  .33*** 

Computer  Course  -,09 


.21***  .21*** 


.16** 

.14**  -.06  .08 

-.04  .13**  .13* 

•07  -.04  -.10* 

•00  -.05  -.08 

•00  -.05  .02 

•09  .04  .07 


*£<.05  **£<.01  ***£<. 001 

Note:  Number  of  cases  ranged  from  276  to 
those  Involving  branching  (with  data  from 


329  for  all  correlations,  except  for 
115  to  125  subjects  analyzed). 
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Abstract 


This  study  compares  the  achievement  of  high  and  low  ability  eighth  grade  students  working 
cooperatively  during  computer-based  instruction.  Students  were  grouped  either  homogeneously  or 
heterogeneously  on  ability,  and  received  identical  instruction  on  a  fictitious  rule-based  arithmetic 
number  system.  No  signfecant  differences  in  achievement  were  found  between  the  two  grouping 
methods.  However,  the  mixed  ability  treatment  substantially  impri)ved  the  achievement  of  the  low 
ability  students  wiAout  an  accompanying  significant  reduction  in  the  achievement  of  the  high 
ability  students.  The  results  indicate  that  designers  and  teachers  may  have  little  to  risk  in  terms  of 
achievement,  but  potentially  much  to  gain  in  socialization  and  interaction,  by  cooperative 
heterogeneous  grouping  during  computer  based  instruction. 


ERLC 


389 

389 


Cooperative  Learning  at  the  Computer: 
Ability  Based  Strategies  for  Implementation 

Educators  interested  in  the  implementation  of  computers  in  education  are  concerned  with 
identifying  models  that  maximize  learning.  One  model  that  has  gained  much  recent  attention 
involves  the  use  of  cooperative  learning  (e.g.  Carrier  &  Sales,  1987;  Johnson  &  Johnson,  1986; 
Johnson,  Johnson,  &  Stanne,  1985;  Mevarech,  Stem,  &  Levita,  1987;  Webb,  Ender,  &  Lewis, 
1986). 

To  many,  cooperative  learning  has  both  strong  intuitive  appeal  and  compelling  practical 
significance.  The  limited  availability  of  computers  in  the  classroom  often  mandates  the  use  of 
group  models  (Hannafin,  Dalton,  &  Hooper,  1987).  Further,  studies  have  generally  indicated  that 
students  often  work  better  in  small  groups  than  individually  (Peterson  &  Janicki,  1979;  Peterson, 
Janicki,  &  Swing,  1981;  Swing  &  Peterson,  1982;  Slavin,  1983).  Consequently,  assigning  a 
computer  to  each  student  may  be  both  unnecessary  and  unwise  (Dalton  &  Hannafin,  1987). 

Cooperative  learning  involves  the  selection  of  a  number  of  students  (usually  between  three  and 
five)  to  work  together  in  groups.  Once  selected,  the  degree  of  cooperation  within  groups  can  be 
manipulated  by  niethbds  that  control  rewards.  Group  members  can',  for  example,  work  toward 
cooperative,  conipetitive,  or  individual  incentives  (Slavin,  1983).  With  a  cooperative  incentive  all 
group  members  are  rewarded  identically,  although  the  method  of  assessing  group  achievement  may 
vary.  Group  membars  may  receive  either  the  score  of  Ae  lowest  achiever  in  the  group,  the  average 
score  of  all  the  group  members,  or  some  other  similar  group  reward.  Competitive  incentives 
involve  comparison  of  all  team  members*  scores,  and  rewards  commensurate  with  success.  Thus 
students  may  work  together  in  the  knowledge  that  helping  other  group  members  may  actually 
reduce  their  own  personal  chances  of  success.  Individual  incentives  may  be  offered  to  individual 
group  members  regardless  of  others*  achievements. 

Of  particular  interest  are  the  relationships  between  student  interaction  and  achi  ;vement  and  the 
effects  of  different  grouping  methods  on  resulting  interaction.  As  part  of  an  investigation  into  the 
influence  of  cooperative  learning  on  achievement,  Webb  (1982)  examined  the  effects  of  giving  and 
receiving  help  during  small  group  learning.  She  found  that  students  who  were  active  in  the 
learning  process,  and  who  gave  explanations  to  other  students,  showed  higher  levels  of 
achievement  than  those  students  who  were  not  actively  involved  in  group  interaction.  Giving 
explanations  involves  forming  associations  between  new  and  existing  information,  and  also 
requires  the  learner  to  form  elaborations  (Webb,  1985).  Elaborations,  in  turn,  aid  retrieval  by 
forming  alternative  pathways  for  the  construction  of  answers  (Gagne,  1985).  Webb  also  found 
that  students  who  sought  and  then  received  help  showed  significant  improvements  in  learning. 
Receiving  help  may  engender  an  atmosphere  of  caring  within  the  group  which  may  in  turn  result  in 
greater  personal  effort  (Slavin,  1978). 

How  should  cooperative  groups  be  formed?  How  should  learners  of  varying  abilities  be 
grouped  to  maxinruze  the  benefits  of  cooperative  grouping?  A  description  of  the  learning  phases, 
proposed  by  Rummelhart  and  Norman  (1978),  may  help  to  predict  effective  models  of  cooperative 
learning.  They  characterized  learning  as  a  process  during  which  the  learner  passes  through  three 
stages  of  understandmg.  In  the  first  stage,  accretion,  the  learner  is  able  to  discriminate  between 
examples  and  non-examples  but  is  unable  to  apply  knowledge  to  new  situations,  or  to  provide 
in-depth  explanations.  During  the  second  stage,  restructuring,  the  learner  is  still  unable  to  provide 
deep  explanations  but  can  now  transfer  some  learning.  Finally  the  learner  enters  the  highest  level 
of  learning,  tuning,  and  is  at  last  able  to  solve  novel  problems,  to  work  effectively  under  stress, 
and  to  provide  deep  explanations. 

This  model  suggests  that  low  ability  students  working  together  in  small  groups  are  likely  to 
flounder  in  an  environment  that  requires  group  members  to  explain  cognitively  complex 
information:  They  are  unlikely  to  reach  the  tuning  stage  for  difficult  tasks.  Consequentlj',  they 
would  be  unable  to  provide  adequate  explanations  of  the  learning  process  to  fellow  group 
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members.  However,  the  model  also  suggests  that  students  in  both  mixed  and  high  ability  groups 
may  benefit  from  cooperative  learning.  High  ability  students  may  better  organize  information 
within  their  own  cognitive  structures  by  giving  in-depA  explanations  (Bargh  &  Schul,  1980). 
This  improved  organization  is  likely  to  deepen  understanding  (Mayer, 1984).  Further,  low  ability 
students,  grouped  with  high  ability  team  members,  are  likely  to  receive  more  individualized  and 
in-depth  explanations  than  possible  from  the  classroom  teacher.  The  extra  instruction  is  likely  to 
increase  learning  for  low  students  widiout  corresponding  decrements  for  high  students. 

One  aspect  of  cooperative  learning  Aat  has  received  little  attention  concerns  the  influence  of 
grouping  on  the  learning  of  increasingly  complex  tasks.  While  low  level  information  generally 
does  not  require  meaningful  encoding,  higher  order  skills,  such  as  rule  application  and  problem 
solving,  often  require  deeper  cognitive  processing.  While  more  able  learners  may  impart  strategies 
to  less  able  students  to  learn  simple  information,  it  is  unlikely  that  higher  level  learning  will  be 
achieved  through  a  limited  exposure  to  cooperative  learning:  Low  students  may  simply  lack  the 
cognitive  structures  required  for  complex  learning.  Consequently,  as  the  complexity  of  the  learning 
task  increases,  the  positive  effects  of  heterogeneous  ability  grouping  for  low  students  will  likely 
dissipate. 

The  purpose  of  this  study  was  to  extend  research  into  computer-based  cooperative  learning  by 
examining  die  effects  of  two  methods  of  ability  grouping,  homogeneous  and  heterogeneous,  on 
the  learning  of  increasingly  complex  concepts. 

Methods 

The  subjects  were  40  eighth  grade  students  selected  from  a  junior  high  school  in  a  rural  area. 
The  students  comprised  approximately  equal  numbers  of  mainstreamed  males  and  females  from 
both  the  top  and  bottom  aHUty  levels  of  pre-algebra  and  general  math. 

Participants,  working  in  small  groups  of  three  or  four  students,  received  a  computer  driven 
tutorial.  To  avoid  the  confounding  effects  of  prior  knowledge,  the  content  was  designed  to  be  as 
content  and  culture  free  as  possible.  The  content  was  based  on  basic  arithmetic  concepts  that  all 
students  of  this  grade  level  should  have  mastered. 

The  tutorial  comprised  four  sections.  In  the  first  s^^'ition  students  were  shown  four  different 
sets  of  novel  symbols,  corresponding  to  the  arithmetic  operations  of  addition,  division, 
multiplication,  and  doubling  and  adding,  as  shown  in  Figure  1.  Each  set  included  three  identical 
constants  (1,2,  and  4),  resulting  in  the  following  operations;  divide  by  1,  divide  by  2,  and  divide 
by  4;  double  and  add  1,  double  and  add  2,  double  and  add  4.  Multiple  choice  questions,  as  shown 
in  Figure  2a,  were  then  presented  concerning  the  meaning  of  the  symbols.  After  10  successive 
correct  questions  students  began  the  second  section. 

Insert  Figures  1  and  2  about  here 

In  the  second  section,  four  examples  were  presented  that  involved  evaluating  the  combined 
values  of  two  symbols.  For  example,  add  2  followed  by  double  and  add  4  (answer  8).  Students 
were  then  required  to  correctly  evaluate  five  successive  pairs  of  symbols,  such  as  shown  in  Figure 
2b,  before  beginning  the  third  section, 

In  the  third  section,  (see  Figure  2c),  students  were  required  to  evaluate  strings  of  three 
symbols.  Three  successive  correct  answers  were  required  to  complete  this  section. 

In  Ae  final  section,  students  were  given  strings  of  five  symbols  to  evaluate.  Examples  of  these 
strings  are  shown  in  Figure  2d.  Four  successive  correct  answers  were  required  to  complete  this 
section.  Students  could  check  the  symbol  meanings  at  any  time  by  selecting  a  help  screen  that 
displayed  all  12  symbols  with  their  corresponding  values.  In  all  four  sections,  immediate  feedback 
was  given  concerning  the  correctness  of  each  response.  Further,  in  the  second,  third,  and  fourth 
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sections  incorrect  responses  were  followed  by  display  of  the  correct  answer. 

To  promote  cooperation  between  group  members,  the  tutorial  contained  an  embedded  strategy 
that  required  students  to  alternate  roles  jrfter  approximately  every  five  questions.  Each  student 
receiyed  a  card  numbered  1,  2,  3,  or  4.  Each  card  specified  the  role  to  be  played  by  the 
card-holder;  decision-maker,  advisor,  or  typist/advisor.  Roles  rotated  when  cards  were  exchanged 
among  group  members. 
Treatments 

There  were  three  cooperative  groupings:  homogeneous  high,  homogeneous  low,  and 
heterogeneous.  High  ability  subjects  were  defined  as  those  from  the  pre-algebra  math  class,  and 
low  ability  subjects  were  defined  as  those  from  gener^  math.  In  the  homogeneous  high  group, 
four  high  ability  subjects  were  assigned  to  each  of  three  groups;  in  Ae  homogeneous  low  group, 
four  low  ability  subjects  were  assigned  to  each  of  three  groups;  in  the  heterogeneous  group,  two 
high  and  two  low  ability  subjects  were  assigned  to  each  of  six  groups. 
Posttest 

To  avoid  the  influence  of  recency,  students  received  a  delayed  posttest:  This  was  administered 
one  week  after  the  initial  treatment.  The  posttest  included  16  questions  at  three  different  levels: 
factual  recall,  application,  and  problem  solving.  Sample  posttest  items  are  shown  in  Figure  3. 


Insert  Figure  3  about  here 


Factual  recall  There  were  four  questions  which  required  recall  of  the  meanings  of  the  symbols. 
Three  points  were  awarded  for  the  correct  operation  and  two  points  for  the  corresponding  constant. 
The  K-R  20  subscale  reliability  was  .70 . 

Application  There  were  six  questions  which  vtqumd  calculation  of  strings  of  two,  three,  and 
five  symbols.  Five  points  were  awarded  for  the  correct  answer  but  no  partial  credit  was  awarded. 
The  K-R  20  subscale  reliability  was  .76 . 

Problem  solving  There  were  six  questions  a*  this  level.  To  test  problem  solving,  subjects 
were  asked  to  generate  strings  of  two,  three,  and  five  symbols  that  together  formed  a  given 
number.  Five  points  were  awarded  for  each  correct  answer.  Two  partial  credit  points  were 
awarded  if  the  given  answer  was  equivalent  to  the  question,  but  contained  no  more  than  one  too 
many,  or  too  few,  symbols.  The  K-R  20  subscale  reliability  was  .84 . 

The  overall  K-R  20  posttest  reliability  was  .90  and  the  individual  item  difficulty  ranged  from 
.20  to  .79  . 

Design  and  Data  Analysis 

The  study  employed  a  2X2(X3)  mixed  factorial  design  featuring  two  levels  of  ability  (high  and 
low),  two  levels  of  grouping  (homogeneous  and  heterogeneous),  and  three  types  of  learning 
(factual  recall,  application,  and  problem  solving).  Posttest  scores  were  analyzed  through  mixed 
effects  ANOVA  procedures. 
Procedures 

Within  the  high  and  low  ability  groupings,  students  were  randomly  assigned  to  treatment 
groups.  Studen^i  were  told  that  they  would  be  tested  individually  one  week  after  receiving 
instruction:  The  treatment  was  then  administered  as  prescribed.  Students  has  one  class  period 
(approximately  45  minutes)  to  complete  the  treatment.  One  week  after  the  instruction,  subjects 
received  a  written  posttest. 

Results 

Posttest  Scores 

The  means  and  standard  deviations  for  each  level  of  the  posttest  are  found  in  Table  1  and  the 
results  of  the  corresponding  ANOVA  are  found  in  Table  2. 
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Insert  Tables  1  &  2  about  here 


As  expected,  the  overall  posttest  means  of  the  high  ability  (61.9)  and  low  ability  (30.5)  groups 
were  significantly  different,  F(l,36)=17.59,  p<.001.  Though  no  significant  differences  were 
found  for  either  grouping  method  or  for  the  ability  X  grouping  method  interaction,  the  predicted 
patterns  were  obtainec.  As  shown  in  Figure  4,  the  low  ability  subjects,  grouped  heterogeneously, 
consistently  scored  higher  than  their  low  ability  counterparts  grouped  homogeneously.  Further, 
although  the  high  ability  subjects,  grouped  homogeneously,  achieved  greater  overall  success  than 
the  other  high  ability  group,  the  pattern  was  inconsistent  over  levels  of  questioning.  In  fact,  the 
high  heterogeneous  group  outsc(»ed  its  counterpart  on  the  problem  solving  questions. 


Insert  Figure  4  about  here 

As  expected,  significant  differences  were  found  for  both  levels  of  questioning,  F(2,72)=72.50, 
p<.001,  and  ability  X  levels  of  questioning,  F(2,72)=4.17,  p<.05.  Post  hoc  analyses  of  the 
interaction  of  ability  and  levels  of  questioning,  using  Tukey  tests,  indicated  significant  (p<.OS) 
pairwise  comparisons  between  factual  and  both  application  and  problem  solving  questions: 
Increasing  die  complexity  of  the  learning  task  resulted  in  differences  in  group  achievement. 
Specifically,  as  the  complexity  of  die  learning  task  increased,  scores  of  both  high  and  low  ability 
groups  were  reduced  However,  aldiough  the  high  ability  group  indicated  significant  reductions  in 
achievement,  die  low  ability  group  demonstrated  performance  scores  diat  suggest  a  fioor  effect  for 
higher  levels  of  learning. 

Discussion 

This  study  examined  two  methods  of  ability  grouping  for  cooperative  learning.  Aldiough  die 
interaction  between  ability  and  grouping  method  was  statistically  insignificant,  the  predicted  pattern 
was  found  between  the  two  treatments.  Further  analysis  of  these  factors  revealed  that  low  ability 
students  in  the  heterogeneous  treatment  showed  a  51%  improvement  in  learning  over  the  other  low 
ability  group,  while  the  high  ability  students  in  the  heterogeneous  group  showed  a  9%  decrease  in 
learning  compared  to  die  odier  high  ability  group.  Stated  differentiy,  the  low  ability  students  in 
mixed  groups  showed  improvement  in  achievement  over  the  other  low  ability  students,  without  a 
negative  effect  on  die  achievement  of  the  high  ability  students  in  mixed  groups.  These  findings 
tend  to  support  previous  cooperative  learning  studies  which  suggest  that  cooperative  learning  poses 
litde  risk  to  die  more  able  tutors. 

While  the  overall  effect  of  grouping  strategies  appears  to  have  litde  influence  on  high  ability 
students,  low  ability  students  grouped  heterogeneously  appear  to  perform  at  higher  levels  dian  dieir 
homogeneously  grouped  counterparts.  Further  investigation  of  the  scores  of  the  low  ability 
students  revealed  diat  while  only  marginal  differences  were  found  between  the  groups  for  problem 
solving,  much  greater  variability  was  found  at  bodi  die  factual  and  application  levels.  Low  ability 
students,  with  poorly  developed  learning  and  problem  solving  skills,  may  quickly  model 
superficial  strategies  that  enhance  learning  of  lower  level  information  through  heterogeneous 
cooperative  learning.  However,  developing  more  complex  learning  skills  to  assist  problem  solving 
is  likely  to  be  a  much  more  difficult  task.  \Vhile  learning  simple  information  is  a  relatively  well 
defined  process  achievable  through  a  number  of  strategies,  learning  die  skills  necessary  to  improve 
problem  solving  is  much  less  well  understood:  These  skills  cannot  be  easily  trained  and  require 
gradual  development  (Deny  &  Murphy,  1986).  Consequentiy,  die  development  of  problem 
solving  skills  is  unlikely  to  take  place  as  a  result  of  limited  exposure  to  heterogeneous  cooperative 
^learning. 

No  significant  differences  were  found  between  the  two  grouping  methods:  This  in  itself  may  be 
noteworthy.  There  are  many  goals  of  education,  odier  dian  academic  achievement,  diat  may  be 
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fostered  by  cooperative  education  such  as  concern  for  other  students'  well  being,  positive  attitudes 
for  students  of  different  ability  levels  (Slavin,  1983),  improved  race  relations  (Stallings  &  Stipek, 
1986),  and  enhanced  self  esteem  for  low  ability  students  (Slavin  &  Karweit,  1984).  Grouping 
strategies  that  promote  important  social  objectives  through  mixed  ability  grouping,  without 
significant  decrements  in  academic  achievement  may  be  preferable  to  competitive  strategies. 

Severalpotential  limitationsof  this  study  warrant  discussion.  One  limitation  may  have  been 
the  lack  of  control  over  intra-gioup  cooperation.  This  study  included  individual  incentives  as  a 
means  of  encouraging  cooperation.  Some  have  suggested  that  students  in  cooperative  learning 
environments  perform  best  if  given  group  versus  individual  incentives  (Johnson,  Maniyama, 
Johnson,  Nelson,  &  Skon,  1981;  Slavin,  1983).  If  so,  group  incentives  might  have  promoted 
greater  cooperation  between  group  members.  Although  tfie  procedures  of  this  study  encouraged 
cooperation,  group  incentives  were  not  used  to  mediate  cooperation  among  group  members. 

&creased  incentives  to  cooperate  are  likely  most  critical  for  heterogeneous  ability  groups  where 
differences  in  learner  needs  are  most  pronounced.  In  a  study  of  ability  based  grouping  methods, 
students  in  heterogeneous  groups  showed  greater  levels  of  interaction  than  homogeneously 
grouped  students  ^ijhof  &  Kommers,  198S).  Group  rewards  may  encourage  higher  ability 
students  to  invest  more  effort  in  advising  less  able  students  and,  simultaneously,  less  able  students 
may  invest  more  effort  in  the  process  of  receiving  help.  The  resulting  deeper  processing  would 
Tkely  manifest  itself  in  improved  test  scores  iLthe  incentives  to  cooperate  are  appealing. 

In  summary,  this  study  supports  the  notion  that  heterogeneous  ability  grouping  may  have  few 
negative  consequences  and  significant  potential  for  both  academic  and  social  outcomes.  In 
addition,  cooperative  grouping  may  help  to  ameliorate  logistical  problems  associated  with  the 
dearth  of  computers  in  the  schools.  Precisely  the  degree  to  which  the  potential  of  heterogeneous 
grouping  is  realized,  however,  is  likely  to  depend  mere  on  internal  group  dynamics  than  on 
learning  from  the  computer  per  se. 
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Table  1 .  Posttest  means  and  standard  deviarions> 
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Table  2.  ANOVA  performed  on  posttest  scores. 
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Add  1 


Add  2 


Add  4 


Multiply  by  1 


Multiply  by  2 


Multiply  by  4 


Divide  by  1 


Divide  by  2 


Divide  by  4  ^ 


Double  and  add  1 


Double  and  add  2 


Double  and  add  4 


Figure  1.  Function  symbols. 
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What  does  the  symbol 
Answer:  d 


Evaluate  the  strmg 

Answer:  4 

Evaluate  the  string 
Answer:  7 


Evaluate  the  string 
Answer:  24 


a]  Add 
r"  ^5in?  b]  Divide 

c]  Multiply 

d]  Double  and  add. 


Figure  2.(a-d).  Examples  of  questions  embedded  in  the  tutorial. 
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Factual  question:  What  does  the  symbol 
Answer;  Add  2. 


mean? 


Application  question:  Evaluate 


Answer:  4 


Problem  solving  question:  Express  16  in  two  symbols. 


Answer: 


Figure  3,  Examples  of  posttest  questions. 
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Figure  4.  Percent  correct  for  facts,  applications,  and  problem  solving. 
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Introduction 


Traditionally  educational  technologists  have  not  been  concerned  with  social 
or  philosophical  questions.  Many  of  the  decisions  made  by  educational  technology 
practitioners  are  based  on  an  incottplete  philosophical  position  or  a  position 
that  is  held  unconscious ly.  Furthermore,  because  of  the  dynamic  nature  of  the 
field,  the  definition  of  educational  technology  has  been  in  evolution*  The 
rapidly  changing  definitions  of  the  field  have  not  provided  sufficient  direction 
to  practitioners.  Additional  guidance  may  be  required  to  aid  technologists  in 
performing  their  role.  This  inquiry  will  pursue  the  question  of  the  relation- 
ship of  educational  philosophy  to  educational  technology.  The  paper 
attempts  ^  to  present  a  conceptual  framework  through  which  educational 
technologists  can  address  the  philosophical  concerns  that  are  crucial  to  these 
professionals  and  those  that  they  serve.  I  will  discuss  some  of  the  criticisms 
of  educational  technology  and  trace  them  to  a  coimon  root.  An  analysis  of  the 
practice  reveals  some  underlying  philosophical  assunptions  about  the  relation- 
ship of  technology  and  education.  With  this  at  hand  I  will  discuss  the 
inportance  of  philosophy  in  addressing  this  issue.  The  development  of  a 
conplete  philosophy  for  education  will  be  advocated  and  an  example  of  a  conp- 
lete  philosophy  of  education  will  be  reviewed.  The  conclusion  will  point  out 
some  of  the  opportunities  for  future  inquiry  into  this  issue. 

Ihis  working  paper  is  by  no  means  exhaustive.^  Issues  of  instructional 
technology  or  educational  technology  for  the  purposes  of  training  and  develop- 
ment in  industry  and  the  military  are  not  considered.  International  settings 
are  not  taken  irto  account.  I  am  confining  this  discussion  to  American  society 
because  I  am  part  of  it,  and  it  is  more  familiar  to  ma  than  other  societies. 
Ihis  does  not  exclude  the  application  of  this  discussion  beyond  an  Anerican  setting. 
However,  this  must  still  be  researched. 
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Criticisms  of  Educational  Technology 
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There  are  many  criuicistns  of  the  field  of  Educational  Technology,    One  of  the 
main  criticism?  of  technology  as  it  is  applied  to  instruction  or  education  is 
that  the  technologisus  fail  to  concern  themselves  with  the  social  and  philosophical 
issues  that  are  involved  in  t^^  process  of  education.    The  literature  suggests 
that  these  criticisms  are  oftai  justified. 

Social  and  philosophical  critiques  of  educational  technology  have  been 
classified  in  a  number  of  different  fachions.  Ihree  major  categories  of 
criticism  are: 

1)  that  it  is  dehumanizing,  (Freire,  1970;  Rogers,  1983;  Apple, 
1982) ; 

2)  that  it  fosters  and  sustains  the  ideological  positions  of  the 
dominant  factions  of  society,  (Apple,  1979;  Kleibard,  1977a); 

3)  that  it  perpetuates  further  dependence  on  technology,  (Hyman, 
1973;  Hyman,  197A). 

A  number  of  lines  of  inquiry  could  be  used  to  analyze  these  social  and 
philosophical  criticisms  as  they  relate  to  educational  technology,  but  time  and 
space  VTill  not  permit  such  an  exhaustive  study. 

Since  it  appears  that  these  stem  from  a  common  root,  one  can  readily 
identify  the  criticisms  of  educational  technology  in  this  regard.  This  root,  a 
comnm  denominator  for  many  of  the  social  and  philosophical  criticisms  of  this 
field,  has  been  called  "Technicism"  (Stanley,  1978)  and  "Technical  Rationality*' 
(Schon,  1983).  ^ 

Manfred  Stanley  (1978)  describes  technicism  as  reflecting  a  particular 
attitude  toward  the  relationship  among  science,  technology,  and  human 
consciousness.  Technicism  is  not  a  deliberate  philosophical  position.  It  is 
the  antithesis  of  an  intentionally  evolved  position.  It  is  a  view  of  the  world 
based  on  ''unconsciously  taken  for  granted  assunptions"  that  are  the  result  of  a 
'•historical  and  cultural  process  rather  than  an  individual  or  collective 
intellectual  decision"  (Stanley,  1978  p.  10).  ^Mle  Stanley  discusses  a 
number  of  ways  to  interpret  technicism,  his  inquiry*  focuses  on  what  he  calls 
pantechnicism"  which  he  defines  as  "a  view  of  the  entire  world  being 
symbolically  reconstituted  as  one  interlocking  problem  solving  system  according 
to  the  dominate  technological  language  of  control"  (Stanley,  1978  p. 10). 

Donald  Schon  (1983)  uses  the  term  "technical  rationality"  in  very  much  the 
same  way  that  Stanley  uses  "pantechnicism."   Schon  writes:    "From  the  perspective 
of  technology  rationality,  professional  practice  is  a  process  of  problem  solving. 
Problems  of  choice  or  decision  are  solved  through  the  selection  of  available  means 
of  the  one  best  suited  to  the  established  ends.    But  with  this  enphasis  on  problem 
solving  we  ignore  the  setting,  the  process  by  which  we  define  the  decisions  to  be 
made,  the  ends  to  be  achieved,  and  the  means  which  may  be  chosen."  (p.  39-AO). 
Technical  rationality  is  a  form  of  technicism. 
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It  is  iitportant  to  point  ouC  that  neither  Schon  nor  Stanley  view  technology 
or  science  as  inherently  evil.  Iheir  discussions  focus  on  the  assunptions 
(explicit/ iirplicit)  held  by  the  individuals  who  investigate  science  and  use 
technology.  The  model  that  currently  dominates  the  investigation  for 
educational  technology  is  the  systems  approach  (Fleshig,  1975)  •  One  might 
conclude  that  the  systems  approach  that  is  used  by  many  educational 
technologists  is  the  target  of  this  criticism.  However,  the  inquiry  into 
technicism  reveals  that  there  are  other  assunptions  held  by  educational 
technologists  that  are  questioned  as  well,  particularly  in  the  area  of 
philosophy  of  science. 

Technicism  has  as  its  base  the  philosophy  of  science  known  as  positivism, 
This  approach  is  based  on  three  major  assunptions: 

1)  that  science,  not  philosophy,  is  the  means  for  attaining 

knowledge; 

2)  that  science,  in  practice,  is  the  act  of  observing;  and 

3)  that  science  and  technology  themselves  are  value  neutral 
(Flew,  1979), 

While  all  three  are  important  to  analyze,  it  is  the  third,  that  science  and 
technology  themselves  are  value  neutral,  which  is  particularly  important  to  this 
paper. 

Technicism  is  the  root  of  the  criticisms  of  educational  technology.  The 
assunption  is  that  science  and  technology  are  valixe-neutral  and  therefore  are 
not  expected  to  transfer  values,  Technicism  holds  that  only  content  is  being 
transferred.  Information  transfer  is  the  goal  of  technicist  thought,  Technicism 
holds  that  outcomes  of  utilizing  technology  are  dependant  on  the  intent  of  those 
that  plan  the  use  of  technology.  This  conception  ignores  the  possibility  of  a 
hidden  ^  curriculum.  It  is  the  failure  to  fully  analyze  the  valtjes  that  are 
inplicit  in  the  use  of  technology  in  education  that  opens  the  door  for  the 
accusations  of  dehumanization  and  the  perpetuation  of  ideological  and 
technological  dependence  that  is  then  passed  on  to  learners.  Educational 
technologists  imist  take  up  the  question  of  what  happens  beyond  their  planned 
intentions  and  actions. 
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It  is  the  belief  held  by  some  technologists,  that  technology  and  science 
are  value  neutral,  that  seems  to  be  most  problematic  to  critics  of  educational 
technology.  An  analysis  of  the  literature  show  that  the  hidden  curriculun,  a 
mode  of  transferring  values  and  assunptions,  exists  within  our  present  educational 
system,  (Jackson,  1968;  Apple,  1977,  1979,  1983;  Kliebard,  1977A,  1977B;  Hyman, 
1973,  197A;  Rogers,  1969,  1983;  Olds  1985;  Silberman,  1970;  (ferbner,  197A; 
Young,  1971,  1973;  Vallance,  197A). 

There  has  been  little  agreement  among  educators  as  to  a  definition  of  the 
hidden  curriculun.  The  literature  concerning  the  hidden  curriculum  extends  in 
many  varying  directions.  Several  doctoral  dissertations  have  attempted  to 
categorize  this  literature  and  ultimately  define  the  hidden  curriculum, 
(Co^ll,  1973;  Weidemann,  1973;  Rain,  197A;  King,  1976),  It  is  iirportant  to  note 
that  \*iile  there  is  some  disagreement  on  definition  there  is  agreement  among 
educators  that  a  tacit  transfer  of  values  does  occur  in  our  schools. 
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There  are  inportant  considerations  involved  with  the  existence  of  the 
hiddai  curriculum  for  educational  technologists.  As  Marshall  McLuhan  so  aptly 
put  it:  'Ve  are  too  concerned  with  using  technique  rather  than  considering  the 
inplicatioos  of  technique"  (1962,  p.  19).  Wilber  Schranm  followed  with  a 
sobering  observation:  '"Ihey  can  learn  what  they  are  intended  to  learn  and  also 
what  they  are  not  intended  to  learn."  (1977,  p. 32).  Schranm  indicates  the 
possibility  that  students  may  acquire  undesired  knowledge  and  skills. 

Depending  on  the  goals  of  the  educational  system,  the  values  that  are 
transferred  may  prove  to  be  functicsial  or  dysfunctional .  Dreeben  (1968)  provides 
a  very  positive  view  of  the  hidden  curriculum  and  its  usefulness  in  the  schools 
and  to  society.  He  focuses  on  the  structural  characteristics  of  schools  and  how 
this  structure  fosters  socially  desirable  norms.  Pappert,  (1980)  outlines  some 
steps  for  the  development  of  a  positive  hidden  curriculun  in  a  cottputer-based 
education  system.  He  enphasizes  intellectual  skills  and  the  natural  growth  of 
the  learners. 

It  would  seem  reasonable  to  believe  that  there  are  always  both  positive  and 
negative  aspects  of  a  hidden  curriculum  in  any  educational  system.  It  would 
seem  equally  reasonable  to  state  that  the  analysis  of  the  hidden  curriculum 
should  be  a  priority  for  educational  technologists.  Ihere  are  opportunities  to 
create  meaningful  learning  experiences  for  students.  The  experiences  need  not 
be  side  effects  of  designed  expository  instruction.  They  can  be  designed  so 
that  the  content  of  the  particular  lesson  is  subordinate  to  the  process  or  the 
hidden  curriculum  of  that  lesson.    However,  this  has  not  often  been  the  case. 

One  reason  why  this  problem  of  value  transfer  faces  educational  technology 
is  the  lack  of  guidance  provided  the  professionals  of  the  field  by  the  very 
definition  of  the  field.  In  a  period  of  less  than  eight  years  the  definition  of 
the  field  has  been  altered  such  that  educational  technology  has  become,  on 
paper,  indistinguishable  from  definitions  of  'instructional  technology,' 
•  instructional  development , '  '  educational  research , '  and  '  curriculum 
development. ' 

In  1970,  the  Presidential  Cotrmission  on  Instructional  Technology  defined 
instructional  technology  in  two  ways. 

First,  "In  its  more  familiar  sense  it  means  the  media 
bom  of  the  cormunication  revolution  vMch  can  be  used 
for  instructional  purposes  along  side  the  teacher,  the 
textbook,  and  the  blackboard. .  .the  pieces  that  make  up 
instructional  technology:  television,  films,  overhead 
projectors,  computers,  and  the  other  items  of  hardware 
and  software. 


Second,  and  less  familiar  definition  of  instructional 
technology  goes  beyond  any  particular  medium  or  device. 
In  this  sense  instructional  technology  is  more  that  the 
sum  of  its  parts.    It  is  the  systematic  way  of  designing, 
carrying  out,  and  evaluating  the  total  process  of  learning 
and  teaching  in  terms  of  specific  objectives  based  on 
research  and  human  learning  and  cocimunication  and  employing 
the  combination  of  human  and  non-human  resources  to  bring 
about  more  effective  instruction." 
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The  Association  for  Educational  Ccmnunication  and  Technology  m 
1972  had  defined  educational  technology  as  follows: 

"A  field  involved  in  the  facilitation  of  human  learning 
through  the  systematic  identification,  developcuent, 
organization,  and  utilization  of  a  full  range  of  learning 
resources  and  through  the  management  of  these  process'^^. 
it  includes,  but  is  not  limited  to  the  development  of 
instructional  systems,  the  identification  of  existing 
resources  and  the  management  of  these  processes  and  the 
people  y^K)  perform  them." 

Ihe  definition      educational  technology  as  put  forth  by  the  Association 
for  Educational  ComirL-dcation  and  Technology  in  1977  states: 

Educational  technology  is  a  complex,  integrating  process 
involving  people,  procedures,  ideas,  devices,  and  organiza- 
tion for  analyzing  problems  and  devising,  implementing, 
evaluating,  and  managing  solutions  to  those  problems  involved 
in  all  aspects  of  huroan  learning." 

Ihe  practice  of  educational  technology  does  not  occur  in  a  vacuum.  Though 
not  mentioned  in  any  definitions,  technology  takes  place  in  a  socio-political 
environment  directed  toward  specific  goals,  there  are  value  inplications  tied 
to  the  definition  of  the  field.  There  is  value  attached  to  each  word  in  each 
definition.  For  example,  the  use  of  the  words  "development"  and  "management"  have 
connotations  which  may  be  as  cortpletely  unacceptable  to  some  educationists  as 
theY  are  absolutely  necessary  for  educational  technologists.  As  values  (explicit/ 
inplicit)  change  the  definition  of  the  field  is  likely  to  change. 

A  broad  definition  of  the  field  need  not  be  an  insurmountable  obstacle  to 
the  practice  of  technology  by  educationists,  as  long  as  we  are  aware  of  what 
valtjes  are  implied.  Personally,  I  welcome  the  opportunities  that  acconpany  'a 
less  structured  field.  It  would  seem  logical,  however,  that  as  the  definition 
broadens  and  provides  less  structure  for  the  specifics  of  the  practice  that 
something  else  is  needed  to  aid  in  the  direction  of  the  field.  I  would  propose 
that  a  conscious  philosophy  be  considered  to  help  guide  the  practice  of 
educational  technologists. 
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Toward  A  Philosophy  of  Technology 

There  is  nothing  mysterious  about  enveloping  philosophy.  Judge  Benjamin 
Cardozo,  (1921)  pKaraphrase  William  James  as  liaving  said  that: 

••Every  one  of  jus  has  in  truth  an  underlying  philosophy  of  life, 
even  those  of  us  to  vhcxn  the  names  and  the  notions  of  philosophy 
are  unknown  and  anathema.    There  is  in  each  of  us  a  tendency, 
vyhether  you  choose  to  call  it  philosophy  or  not,  vhich  gives 
coherence  and  direction  to  thought  and  action/' 

It  would  seem  that  all  of  us  hold  a  philosophy.  A  value  clarification  exercise 
would  reveal  a  nunber  of  values  and  philosophical  principles  that  are  wi-diin 
each  one  of  us.  The  level  of  sophistication  and  the  level  of  awarene^-^  of  this 
philosophy  might  vary  with  each  individual.  VMle  some  mi^t  disagree  ^^^th  me, 
I  do  not  believe  that  developing  a  consciousness  about  philosophy  requires  a 
high  degree  of  technical  skill*  Further,  it  need  not  be  reserved  for  those  who 
hold  graduate  degree;  Do  not  infer  that  I  am  making  li^t  of  such  an  enter- 
prise; it  is  not  an  easy  task.  I  believe  it  to  be  among  the  most  inportant 
undertakings  to  which  an  individual  can  aspire.  All  people  make  value  judge- 
ments. Few  make  a  serious  attempt  to  consciously  develop  a  philosophy •  Fewer 
still  persevere  and  continue  the  questioning. 

A  conscious  philosophy  is  generated  as  a  result  of  one's  T.eed  to  understand 
and  explain  natural,  social,  and/or  personal  conditions*  It  will  also  act  as  a 
guide  for  one's  actions  and  aspirations.  Most  people  are  enculturated  into 
various  philosophical  frameworks  vMch  serve  to  direct  their  lives.  To  truly 
develop  a  philosophy  one  must  search  beyond  the  conceptions  and  assiir^tions  that 
are  currently  held.  A  reflective  self  analysis  is  required.  This  investigation 
and/or  formulation  of  alternative  positions  is  a  continual  process  based  on  the 
experience  and  reflection  of  the  individual. 

This  constant  "reconstruction"  (Dewey,  1920)  of  thoughts  and  ideas  of 
philosophy  may  be  the  reason  for  the  popular  belief  that  one  may  hold  a 
particular  philosophy  and  that  one  may  do  philosophy.  To  be  sure,  not  all 
philosophers  wcitld  agree  wi.th  Dewey's  assertion  that  "doing"  philosophy  and 
'^holding"  philosophy  are  the  same  thing.  I  will  follow  Dewey's  lead  and  proceed 
with  the  assumption  that  there  is  an  unnecessary  dualism  between  these  concepts, 
"doing"  philosophy  and  "holding"  philosophy.  It  is  believed  that  the  values 
ijiplicit  in  ones  actions,  that  xchich  one  does,  are  the  same  as  one  consciously 
believes,  that  which  one  hcdds.  The  actions  one  takes  may  be  interpreted  as 
exprei  ing  a  held  belief.  If  one  is  consistent  between  actions  and  belief,  then 
philosophy  is  both  a  means  snd  an  end. 

The  question  arises,  "Why  philosophy  as  a  guide  to  practice,  why  not 
theory?"  Victor  Farganis  (1975)  states  there  are  values  inplicit  in  any  of  the 
social  sciences.  Education  may  be  considered  a  social  science.  These  implicit 
value  considerations  are  what  give  a  particular  theory  or  a  conception  meaning 
and  prevent  it  from  acting  as  a  neutral  vehicle.  In  short,  theory  is  value 
laden.  When  theory  is  put  into  practice  it  is  a  philosophical  act.  Regardless 
of  the  intentions  behind  the  act,  values  are  articulated  and  may  be  transferred. 
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Education  is  often  oriented  to  practical  activity.  Technologists  often 
make  decisions  based  on  practical  experience,  but  also  based  on  their  values 
(explicit/ inplicit) ♦Practical  experiences  cannot  provide  them  with  the  escape 
from  an  essential  principle.  ••That  principle  addresses  itself  to  the  question 
of  vAiat  vje  ought  to  do  v^ien  we  teach.  This  is  particularly  inportant  in  a 
technological  society  \diere  the  relationship  between  knowledge  and  human  affairs 
is  often  obscured",  (Kliebard,  1977b,  p.  3A).  What  "is"  should  not  modify  what 
"ought"  to  be.  The  present  state  of  technology  should  not  necessarily  modify  the 
goals  and  values  of  education.  The  state  of  practice  should  be  made  consistent 
with  the  gpals  and  values  of  education. 

Every  human  activity  presupposes  values  that  are  essential  to  that  activity. 
"Science,  for  example,  presi^pposes  the  worth  of  knowing  those  things  that  science 
discovers.    If  you  deny  the  proposition  that  these  thirds  are  worth  knowing,  then 
there  is  no  sense  in  doing  scientific  work"  (Magee  1971  p.  1A7).    The  same 
can  be  said  for  technology  as  the  application  of  science  (Romisowski,  1981). 
It  too  presupposes  values.     From  there  it  would  follow  that  educational 
activities   assume  some  principles  and  values  that  must  be  accepted  if  you  are 
going  to  seriously  consider  them.    Ihese  principles  or  values  fall  into  two 
groups;  those  that  are  about  the  discussion  of  the  school  as  an  organization  and 
its  curriculum  content  and  those  that  are  concerned  with  ideas  of  teaching  and 
learning.    For  example,  the  existence  of  school  adninistrative  systems  pre- 
supposes that  an  authority  structure  is  indeed  worth  having. 

We  need  to  spell  out  all  of  the  elements  pre-sipposed  by  our  actions.  To 
paraphrase  Socrates,  unexamined  education  is  not  worth  doing.  Socrates  con- 
cluded that  few  people  really  bother  to  undertake  tb^  inquiry  necessary  to  know 
what  they  were  about.  Such  migjit  be  the  case  with  technists. 

There  are  two  major  advantages  in  wanting  to  be  clear  about  ^A^at  one  is  try- 
ing to  do.  First  is  that,  upon  further  examination  it  may  turn  out  that  one 
may  not  be  doing  what  one  really  intends  to  do.  Such  self  examination  of 
educational  efforts  may  suggest  changes  that  could  result  in  a  more  desirable 
type  of  educational  technology  than  is  currently  practiced.  The  second,  is  that 
such  an  examination  will  enable  practitioners  to  enter  into  discussions  about 
their  practice.  The  dialogue  that  should  follow  is  bound  to  improve  the  quality 
and  quantity  of  the  wisdom  and  knowledge  that  goes  into  educaticm  and 
educational  technology. 

A  value  analysis  must  be  undertaken.  This  can  only  be  approached  through 
a  conscious  effort  by  practitioners  and  researchers.  But  this  clarification  is 
never  finished.  As  technology  and  education  change  at  all  levels,  it  would  seem 
that  the  vdx)le  enterprise  must  constantly  be  re-examined.  Since  the  central 
questicais  of  instructional  or  educational  technology  are  actually  value 
questions,  a  philosophy  vMch  could  fiffiction  to  help  guide  this  practice  would 
be  of  considerable  help. 

It  is  inperative  for  students  and  for  society  as  a  whole  that  practitioners 
in  educational  technology  kno^?  and  understand  the  idea  of  what  it  is  they  are 
doing  and  perhsps  more  important,  vAiy  they  are  doing  it. 
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Again,  Dewey,  (1938a)  says: 


''the  difference  between  educational  practices  that 
are  influenced  by  a  well  thought  out  philosophy  and 
practices  that  are  not  so  influenced  is  the  difference 
between  education  conducted  by  some  clear  idea  of  the 
ends  in  the  way  of  ruling  attitudes  of  desire  and  purpose 
that  are  to  be  created  and  an  education  that  is  conducted 
blindly  under  the  control  of  customs  and  traditions  that 
have  not  been  examined  or  in  response  tc  immediate  social 
pressures."  (p.  99) • 

Investigation  into  the  conduct  of  educational  practice  should  result  in  the 
beginning  of  an  inquirj''  into  the  hidden  curriculum.  It  is  also  a  step  toward 
identifying  and  understanding  the  technicist  assunptions. 


An  Alternative:  A  Complete  Philosophy  for  Education 

It  seems  reasonable  to  think  that  the  paradigpi  of  wholes,  that  is  system 
theory,  (Bertalanf^,  1968)  should  be  guided  by  a  complete  philosophy.  The 
complete  philosopher  will  not  only  analj^e  in  the  ways  that  have  been  described 
in  languages  and  valines,  but  will  also  speculate  about  the  world  as  a  whole; 
about  goals,  norms,  and  human  experience  providing  some  guide  to  acticsi. 

William  Frankena  provided  a  useful  mapping  of  a  more  conplete  philosophy  in 
his  book  Philosophy  of  Education  (1965).  In  that  book  he  identifies  five 
points: 

a)  a  statement  of  basic  ends  or  principles  of  ethics 
and  social  thought 

b)  (enpirical  and  other)  premises  about  human  nature, 
life,  and  the  world 

c)  a  list  of  excellences  to  be  produced 

d)  scientific  knowledge  about  how  to  produce  then 

e)  concrete  conclusions  about  what  to  do,  vten,  and 
how,  and  so  on, 

Frankena  explains  his  o\^erall  outlook: 

''Education  is  the  process  by  which  society  makes  of  its 
maimers  v^t  is  desirable  that  they  should  become... 
either  in  general  or  in  so  far  as  this  may  be  called 
•schools'."  (p.  95). 

Frankena's  steps  to  guide  practice  are  most  useful.   Mi^ee  (1971)  outlined 
Frankena 's  map  (figure  1)  and  describes  Frankena 's  work  as  follows: 
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Statement  of  basic 
ends  or  principles  of 
ethics  and  social  thought. 


B 

Empirical  and  other 
premises  about  human 
nature,  life,  and  the  world. 


List  of  excellences 
to  be  produced. 


D 

Empirical  or  Scientific 
knowledge  about  how  to 
produce  them. 


Concrete  conclusions 
about  what  to  do,  when, 
how  and  so  on. 


William  K.  Frankena  (ed).  Introduction  to  Philosopliy  of  Education.  New  York:  Macmiiian,  1965 
qiintarf  In  Philosophical  Analysis  in  Edimatlon.  Magee  1 971 .  p.45. 
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"With  this  as  a  frame  of  reference,  he  sorts  out  the  desired 
levels  of  knowrledge  that  function  as  our  guides  to  decision 
making  in  practical  educational  affairs.    Conclusions  at  E 
(judgements  about  what  to  do)  are  a  mixture  of  jiidgements  about 
the  "excellences  to  be  produced"  (C)  in  the  beneficiaries  of  the 
educational  process,  combined 'with  "enperical  or  scientific 
knowledge  about  how  to  produce  them"  (D) .    It  is  ijiportant  to 
notice  that  we  cannot  derive  the  list  of  prescriptions,  excellences, 
that  are  a  set  of  value  judgements  about  \*iat  to  do,  from  the 
descriptive,  empirical,  knowledge  accounts  of  what  the 
facts  actually  are*    It  is,  in  short,  not  possible  to  go 
directly  from  scientific  understanding  to  policy  and  practice. 
Practice  is  always  a  coirbination  of  prescriptive  convictions 
and  descriptive  understanding. 

Going  back  up  the  ladder,  we  can  see  that  C,  the  list 
of  excellences,  is  itself  a  judgnent  based  vpoa  a  judicious 
ccdbination  of  A,  our  presuppositions  of  the  basic  ends  of 
life  and  the  fundamental  principles  of  right  action  and  ri^t 
social  organization,  and  B,  or  presuppositions  concerning  human 
nature,  life,  and  the  world.    This  latter  concept  is  itself 
complex,  consisting  not  only  of  the  empirical  or  comoaon  sense 
facts  about  nature,  life,  and  the  world  as  we  believe  them  to 
be,  but  also  our  ultimate  presijppositions  about  existence,  our 
metaphysical  beliefs,  and  existential  cocmitnents,    llaese  latter 
can  include  such  notions  as  belief  in  God  or  a  naturalistic 
rejection  of  such  belief. 

We  can  sumnarize  this  ladder  by  sajdng  that  E,  our  concrete 
conclusion  about  vAiat  to  do,  prestpposed  judgpaents  about  values  <C) 
and  enpirical  claims  (D) .    C  in  turn  presupposes  our  ultimate 
convictions  about  values  and  moral  principles  (A)  in  conobination 
with  our  presuppositions,  empirical  and  otherwise,  about  human 
nature,  life  and  the  world."  (Magee,  1971) 

When  determining  a  personal  or  organizational  philosophy  about  the  use  of  technology 
one  nust  try  to  be  clear  about  the  inter-relationships  of  the  different  aspects  of 
philosophy  and  how  they  relate  in  the  educational  process."^   Frankena  has  danon- 
strated  the  relationship  of  theory  and  practice.  Magee  has  done  a  marvelous  job 
of  explaining  the  relationships  described  by  Frankaia. 

I  would  agree  with  Frankena  that  the  driving  force  behind  a  conplete 
philosophy  of  education  is  a  social  philosophy,  a  sense  of  social  vision.  I 
would  also  agree  that  social  philosophy  in  conbination  with  epistomolpgical  and 
metaphysical  concerns  play  a  major  role  in  forming  the  ethics  of  a  society.  But 
Frankena 's  approach  seems  to  be  a  bit  too  hierarchical.  It  appears  to  deny 
interaction  among  the  varying  aspects  of  philosophy.  I  believe  that  any  one 
aspect  of  philosophy  can  effect  another  and  there  is  a  more  interactive  and 
equal  relationship  among  them  than  is  portrayed  in  the  Frankena  model.  My  point 
is  that  a  complete  and  philosophical  construct  is  not  necessarily  a  hierarchial 
one. 
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Certainly  there  is  a  driving  concept  but  that  driving  concept  is  subject  to 
change  based  on  the  influence  of  other  aspects  of  the  philosophy  at  various 
points  in  time.  In  this  conception  of  educational  philosophy  both  philosophical 
analysis  and  axiology  are  relevant   concerns  at  any  point  dinring  the  discourse. 

We  have  seen  in  the  representation  of  Prankena's  "ladder"  an  attempt  to 
formulate  a  ccnplete  philosophy  for  education  and  educational  practice.  I 
believe  the  ladder  analogy  is  a  convenient  way  to  visualize  the  relationship  of 
the  various  aspects  of  philosophy  to  practice  and  hence  is  a  useful  framework 
through  which  educational  technologists  may  analyze  and  develop  their  practice. 
However  xisefiil  this  concq>tion  is,  I  find  nyself  feeling  that  it  is  not  totally 
accurate . 
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It  is  incomplete  for  two  reasons.  First,  it  does  not  fully  represent  the 
thoughts  involved  in  axiology  and  it  seems  to  ignore  the  aspect  of  aesthetics. 
It  has  been  said  that  axiolpgy  is  intertwined  with  metaphysics  and  epistonology 
to  the  point  where  the  discussion  of  one  leads  to  an  implicit  discussion  of  the 
other  (Kbettig,  1983).  Frankena  seems  unwilling  to  try  to  separate  them.  I 
would  fully  agree  that  the  three  are  intertwined  and  a  discussion  of  one  in 
isolation  is  next  to  inpossible.  Throughout  this  paper  I  have  enphasized  the 
importance  of  values  and  value  transfer  in  the  practice  of  educational 
technology.  I  have  said  that  value  transfer  is  the  basis  for  analyzing  the 
hidden  curricultm.  Value  reflection  is  an  activity  that  is  aimed  at  identifying 
our  presuppositions.  For  those  reasons  I  would  like  to  eiiphasize  axiology.  In 
the  educational  endeavor,  value  inquiry  merits  a  special  attention.  As  a 
socially  construed  institution,  education  is  more  concerned  with  issues  of  value 
than  it  is  with  conceptions  of  knowledge  and  reality. 

Exclusion  of  aesthetics  from  "Frankena 's  ladder"  is  a  value  decision  as  is 
my  decision  to  include  it.  I  choose  to  include  it  for  two  reasons.  The  first 
is  that  teaching  is  an  art  (Dewey,  1928).  The  application  of  science  is 
technology;  the  application  of  technology  is  an  art.  The  second  reason  is 
derived  from  reflection  on  the  field  of  educational  technology  and  its 
possibilities  in  practice.  McLuhan  (1964)  states:  "Ihe  artist  is  the  man  in  any 
field,  scientific  or  humanistic,  grasps  the  implications  of  his  actions  and 
of  new  knowledge  in  his  own  time."  (p. 51). I  hope  that  the  increased  awareness 
will  contribute  to  the  art,  the  practice  of  Educational  Technology. 

Another  reason  I  believe  that  "Frankena' s  ladder"  is  incomplete  is  that 
it  does  not  attempt  to  show  the  relationships  among  the  differing  aspects 
of  Philosophy  beyond  epistomology,  metaphysics,  and  axiology.  I  am  left  with 
the  impression  that  Frankena  does  not  represent  these  relationships  and  does  not 
feel  that  it  is  necessary  to  acknowledge  them.  The  ladder  is  not  mlike  a 
sijiple  algorithm.  It  is  similar  in  style  to  many  of  the  models  that  educational 
technologists  use  to  represent  design  and  development  processes.  I  do  not  wish 
to  characterize  Frankena  as  a  technicist  philosopher,  but  I  think  that  we  have  seen 
that  there  are  relationships  between  all  of  the  aspects  of  a  cotiplete 
philosophy.  , 

I  should  like  to  point  out  that  this  is  not  the  only  way  to  conceive  of  a 
complete  philosophy  of  education.  There  is  certainly  no  one  "right"  way  to  do 
this  sort  of  inquiry.  The  ideas  represented  in  both  the  frameworks  for  a 
conplete  philosophy  for  education  are  the  results  of  an  exercise  in  logic.  In 
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Frankena's  case  the  social  ideal  is  conceived  and  then  a  framework  is  developed 
to  achieve  that  ideal*  It  is  iiiportant,  but  not  essential  that  this  model 
identifies  a  social  vision  as  its  aim*  This  need  not  always  be  the  case. 
Conceivably  one  could  develop  in  the  direction  of  ethics  or  some  other 
philosophical  aspect  of  education.  One  advantage  to  losing  the  complete 
philosophic  framework  is  that  it  should  serve  to  reduce  the  negative  side 
effects  of  the  hidden  curriculum.  With  proper  analysis  of  the  concept  and 
possibilities  of  educational  outcome,  technologists  may  be  able  to  devise  a 
process,  a  hidden  curriculum,  consistent  with  their  social  vision  and  that  of 
their  clients.  But  this  can  only  be  done  after  a  complete  philosophical  inquiry 
has  been  undertaken* 


Questions  tor  Future  Inquiry 

One  question  that  was  raised  in  writing  this  paper  is,  "Given  this  new 
context  from  doing  educational  technology  witWn  an  educational  philosophy,  jAiat 
mi^t  a  new  definition  of  the  fi.eld  look  like?" 

Other  possibilities  include  a  dialogue  on  the  development  of  social, 
ethical,  and  educational  aims.  This  is  certainly  a  conceptual  inquiry  and 
research  as  to  what  and  how  chese  aims  need  to  be  identified  and  advanced. 

Further  conceptual  analyses  of  the  "factors"  of  our  field  would  be  nest 
welcome,  other  implicit  values  and  assunptions  must  be  identified.  This  would 
certainly  be  necessary  and  desirable  before  we  begin  to  move  in  the  direction  of 
social  philosophy.  Failure  to  do  so  could  very  well  result  in  something  less 
desirable  that  we  have  in  current  practice. 

Another  possibility  for  future  research  includes  the  development  of  a 
philosophy  of  science  for  educational  technology.  To  date,  we  have  seen  in  the 
article  by  Ely,  (1970)  '"Towards  the  Philosophy  of  Listructional  Technology",  a 
movement  away  from  a  physical  science  concept  of  technology.  I  am  aware  of 
other  works  in  the  area  of  philosophical  inquiry  into  technology  (Becker,  1977; 
Koetting,  1981;  and  Lukowski,1981) .  A  philosophy  of  science  for  our  field  most 
include  aspects  of  connwnications  theory  as  well  as  phenomonology  and  hermeneutics. 
It  would  synthesize  ideas  from  the  behavioral  science  concept,  the  physical 
science  concept  and  the  mass  communications  concept,  into  a  social  science 
concept  of  educational  technology.  This  view  should  prove  to  be  more  conceptual 
and  more  naturalistic  in  practice  but  this  certainly  would  not  lead  to  the 
demise  of  the  field.  The  current  paradigpi  shuns  the  premise  of  general  system 
theory  that  the  whole  is  greater  than  the  sum  of  its  parts.  At  present  it  seems 
as  if  we  are  somewhat  inconsistent  in  the  way  we  do  our  inquiry  based  on  the 
model  we  use  to  conduct  our  practice. 

Elgon  Cuba  and  John  Clark  (197A)  have  suggested  three  criteria:  conplete- 
ness,  balance,  and  realism  by  which  to  assess  conceptual  structures.  I  would 
recomnnend  that  this  assessment  tool  be  lised  to  analyze  the  model  I  have  proposed 
and  the  component  parts  of  that  model  as  they  are  ftirther  developed. 
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Finally  v?e  must  investigate  the  side  effects  or  potential  persuaders  in  the 
hidden  curriculum.    The  idea  of  investigating  \ghat  are  positive  and  v^t  are 
negative  aspects  of  the  hidden  curriculun  in  relation  to  current  practices  is 
desirable.   Again,  educational  technology  nust  look  within  itself.    Such  powerful 
influences  on  educational  practice  cannot  be  ignored.    It  nust  be  remembered  that 
even  vjhen  practitioners  and  researchers  investigate  technicism,  they  are  still 
actors  involved  with  institutions  that  perpetuate  it. 
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Ehdnotes 

L 


The  author  is  interested  in  contributing  to  a  dialogue  on  issues  involving 
philosophy  and  educational  technology,  and  welcomes  any  cSmients  S  Si?^aS^ 

2 

rnni^Jr^V'  "^L^^  technicism  in  order  to  be  consistent  and  eliminate  any 
confusion  for  the  reader  that  nay  coma  about  because  of  multiple  terms.  ^ 


3, 


I  believe  that  there  are  nine  aspects  of  philosophy  that  should  be 

S^re1^e'^a1S,2^f^-  '^^''"^  applieVS  elation. 

«ill  nSfnlT^^  °/  definitions  of  any  of  these  philosophical  aspects  but  I 
will  provide  a  brief  statement  of  what  it  is  that  I  mean  by  these  Srms.  Ihe 

1)  Social  Philosophy  -  a  conprehensive  vision  about 
how  society  ought  to  be. 

2)  Ethics  -  a  set  of  moral  positions  which  are  consistent 
and  acceptable  in  relation  to  the  social  philosophy, 

3)  Aesthetics  -  the  study  and  assumptions  that  guide  the 
inquiry  and  interpretation  of  art.  One  might  study  art 
in  terms  of  the  managanent  of  technology  as  applied  to 
education, 

4)  Philosophy  of  Science  -  the  study  and  assunptions  that 
guide  the  inquiry  and  interpretations  of  the  disciplines 
For  purposes  of  this  paper  it  will  also 'include  the 
philosophies  of  history,  mathematics,  and  law, 

5)  Philosophy  of  Mind  -  the  study  and  assurptioris  that 
guide  the  inquiry  and  interpretation  of  the  process  of 
thinking,  reflection,  and  imagination, 

6) 


7) 
8) 


 j-^^iicuxuii,  eiiiu  unagination. 

Metaphysics  -  the  assunptions  that  attempt  to  characterize 
existence  or  reality  in  its  entirety.    For  purposes  of  this  paper 
It  will  be  considered  as  inseparable  from  epistomology. 

Epistomology  -  the  study  and  assumptions  that  guide  the  inquiry 
and  interpretation  of  the  nature  and  purview  of  knowledge, 

Axiolpgy  -  the  study  and  assunptions  that  guide  the  inquiry 
and  interpretations  of  value.  ^  j 


9)     Analytic  Philosophy  -  the  study  and  assumptions  that  guide  the 
inquiry  and  interpretations  of  the  logic  of  language. 

4 

, «    •     ^lu         ^  acknowledge  those  who  assisted  in  the  preparation  of  this 
^f  ^i!:°Vfi^^  E^P^''-    ■n^^'*  are  many  who  contributed.    Specif i^allyTw^ld  like 
to  thank  Alice  Berg,  Salvu  Ohircop,  James  Cox,  and  Rob  Pearson     Sik  ^ 
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INTRODUCTION  AND  PURPOSE 
As  researchers    in  the  -field  *o-f  instructional  systems  technology, 
we  are    often  called    upon  to    answer  such    queries  as:      What  is 
research     in     instructional     technology?    How    does    it  relate  to 


research  interestsand  the  theory  that  supports  it.  But  vjhat 
about  the  big  picture?  Is  their  a  model  or  theory  o-f  reseach  in 
your  -field?  While  we  can  discourse  readily  on  the  historical 
development  o-f  our  research,  -from  evaluative  comparison  studies 
through  attributes  o-f  media  studies  to  information  processing  and 
intelligent  systems  research,  can  we  identify  and  construct  an 
appropriate  schemata  for  research  in  our  field?  Just  what  is  our 
knowledge  domain? 

Our  knowledge  domain  consists  of  a  coherent  set  of  concepts  that 
we  use  to  identify  our  field.  Just  as  concepts  are  combined  by 
relationships  to  form  principles,  our  field  cannot  be  described 
by  its  concepts  alone.  Rather,  our  knowledge  domain  consists  of 
both  schemas  or  ideas  in  addition  to  structural  knowledge. 
Structural  knowl edge  descr  i  bes  the  i  n  terre 1  at  i  onsh  i  ps  between 
ideas     in    our    kno^jledge    domain.  The    problem      is    how  to 

operationalize  structural  knovj]  edge . 

1ST  researchers  usually  define  the  domain  of  their  own  research 
adequately  in  terms  of  existing  theory.  That  i?.,  their  cognitive 
structures    for    1ST    research    and  theorv  is  comprised  mostly  f 


existing  theory  in  the  field? 


We    are    familiar    with    our  own 
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research  on  which  they  ha^e  worked  and  its  supporting  theory. 
The  individual's  knowledge  base  enables  him  or  her  to  build  new 
knowledge  strucures,  make  inferences,  solve  problems,  and  so  on 
<Norman,  Gentner,  &  Stevens,  1974). 

The  best  way  of  depicting  these  knowledge  structures  is  by 
constructing  cognitive  maps  (Jonassen,  1987}  Shavelson,  1985), 
Cogn  i  t  i  ve  maps  descr  i  be  the  the  assoc  iative  structure  of 
constructs  stored  in  memory.  They  are  based  upon  the  concept  of 
semantic  proximity  of  constructs,  which  assumes  that  we  can 
represent  the  (semantic)  proximity  of  ideas  in  memory  in  terms  of 
geometric  space.  Cognitive  maps  are  produced  from  measurements 
and  i  nt>;,'rpreted  as  abstract  representations  of  oner's  knowledge 
of  subject  matter  content  <Shavelson,  1985),  The  measurement  of 
cognitive  representations  of  subject  matter  structures  permits  us 
to  examine  the  list  of  constructs  associated  with  any  construct, 
the  overlap  between  those  constructs,  and  the  relationships 
betvjeen  pairs  based  upon  that  overlap.  The  simplest  method  for 
constructing  a  cognitive  map  is  to  rank  the  degree  of  similarity 
between  concepts.  Statistical  procedures  like  MDS,  cluster 
analysis,  or  principal  components  analyze  the  underlying 
structure  of  the  i ntercorrel at i on  matrices  to  produce  a  map  of 
the  knowledge  domain  in  which  the  geometric  distances  between 
each  of  the  concepts  on  the  map  represents  the  semantic  distance 
between  those  concepts  in  memory. 
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The  purpose  of  this  study  is  to  generate  such  a  map  which  can 
serve  as  a  definition  of  a  sdhemata  for  1ST  research.  The  study 
seeks  to  define  the  structure  of  research  and  theory  in  our  field 
by  generating  a  "cognitive  map"  of  the  concepts  or  schemas  that 
define  it.  Using  the  technique  defined  by  Diekhoff  and  Diekhof^ 
(1982),  the  primary  set  of  concepts  in  1ST  research  were  compared 
for  similarity  with  all  of  the  other  concepts  in  a  pairwise 
fashion,  with  the  structure  defined  by  the  i n tercorre 1  at i on 
matrix  of  similarities.  The  structure  was  mapped  to  provide  "the 
big  picture" . 


METHOD 


Part  i  c  i  pants 

Participants  were  selected  from,  the  members  of  the  Reseach  and 
Theory  Di  v  i  si  on  <RTD)  of  the  Assoc  i  at  i  on  for  Educat  i  onal 
Communications  and  Technology.  This  membership  is  the  group  most 
concerned  and  involved  with  research  and  theory  development  in 
the  1ST  field. 
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Instrument 

The  first  task  was  to  identify  the  most  important  constructs  or 
schemas  in  the  1ST  research  field.  Three  sources  were  used. 
First,  a  study  of  research  interests  of  the  membership,  recently 
conducted  by  the  division,  identified  107  topics  in  research  and 
theory  development     in  the    field.       Second,  a    review  of  titles, 
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headings,     and    keywords    from    the    nine    Molumes  of  Educational 
Commun  i  cat  i  ons    and    Technol  cjgy    Journal     generate  d    126  terms. 
Third,     the    ERIC    thesaurus    oi  descriptors  produced  139  related 
terms.     This  list  was  first     edited    for    redundance.        Next  the 
total   list  was  edited  using  the  following  criteria  for  inclusion: 

*  generality  (universality)  of  the  term 

*  recogn i zabi 1 i ty  by  researchers 

*  redundance  (elimination  of  redundant  or  duplicative  terms) 

*  relevance  to  the  fjeld  of  1ST  theory/research 

*  critical  ity  to  the  field  -  importance  of  the  concept  to 
research 

*  commun i cabi 1 i ty  to  related  fields  of  research 

After  editing,  the  f  nal  list  comprises  126  terms  (see  Table  1). 
These  terms  represent,  according  to  the  above  criteria,  the  key 
concepts  or  schemas  that  define  research  and  theory  in  1ST. 

Part  1:  The  first  part  of  the  survey  listed  the  56  concepts  and 
asked  the  participants  to  rate  on  a  1-9  scale  the  importance  of 
each  term  to  the  field  of  1ST  research  and  theory.  The  list  was 
generated  by  a  BASIC  proi^/am  which  randomly  selected  the  items 
from  the  whole  list. 

Part  2:  A  BASIC  program  was  written  to  generate  the  second  part 
of  each  survey.  This  part  consisted  of  a  100  pairwise 
comparisons  of'  randomly  selected  concepts  from  the  final  list. 
For  each  pair  of  concepts,  the  participant  was  asked  to  rate  on  a 
1-9  scale  the  degree  of  similarity  or  relatedness  between  the 
terms  in  each  pair.  Item  sampling  was  initially  done  from  the 
entire  list.      Because      a    pairwise  comparison    of  all   126  terms 
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would  require  7875  comparisons  and  adequate  sampling  could  not 
provide  multiple  responses  to  each  cell,  the  35  most  important 
concepts  were  selected  from  the  Part  1  oi  the  responses.  These 
concepts  are  underlined  in  Table  i«  These  concepts  were  then 
completely  sampled,  -forming  a  37X37  matrix. 


The  importance  ratings  from  Part  1  of  the  survey  are  underlined 
in  Table  i.  The  responses  to  the  pairwise  comparisons  of  those 
35  concepts  were  aggregated  by  pair  in  a  matrix.  The  final  cell 
value  tor  each  comparison  consisted  of  the  modal  value.  If  no 
mode  was  obvious,  then  the  means  for  each  pair  were  calculated. 
These  values  for  each  comparison  formed  an  35X34  similarity 
matrix  which  was  analyzed  using  non-metric  mul t i -dimensi onal 
seal  ing  <MDS) . 

The  MDS  analysis  was  performed  using  two,  three  and  four 
dimensi  onal  sol ut  i  ons.  The  four -dimensi  onal  sol ut  i  on  accounted 
for  the  greatest  amount  of  var  i  ance ,  SStress=. 195,  R  squared=.54. 
Th  i  s  was  a  si  gn  i  f  i  cant  improvemen  t  over  the  two-dimensi  onal 
solution,  which  accounted  for  only  3A'A  of  the  variance.  The  high 
stress,  as  reflective  of  the  unaccounted  variance,  probably 
resulted  from  the  fact  that  the  comparisons  were  based  upon  the 
perceptions  of  several  people.  In  order  to  reduce  that  variance, 
an  individual     differences  model  of  ALSCAL  MDS  program  would  have 


RESULTS 


Anal ysi  s 


439 


to  be  used.  That  would  require  several  people  -filling 
completcing  1190  compariso'ns  for  the  smaller  matrix  and  7858 
comparisons  for  the  full  matrix.  Stress  could  also  be  reduced  by 
adding  addi tonal  dimensions. 


The  plot  for  the  two  dimensional  solution  is  presented  in  Figure 
1.  The  multiple  plots  for  the  four  dimensional  solution  are 
available  upon  request.  Interpretation  of  multiple  dimensions  is 
problematic.  In  two-dimensional  space,  four  clusters  appear  to 
have  formed;  learning  psychology,  instructional  message  design, 
instructional  design,  and  a  types  of  learning.  Both  dimensions 
appear  to  represent  a  learning  theory  into  design  practice 
continuum.  Dimension  1  represents  a  learning  type  into  message 
design.  Dimension  2  is  information  processing  into  instructional 
design  dimension. 

Di scussi  on 
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It  is  obvious  that  any  network  description  of  research  and  theory 
in  our  field  is  mul t i -dimensi onal .  It  is  a  mul t i -faceted  field. 
Using  the  two-dimensional  solution,  the  MDS  solution  describes  a 
two-dimensional  theory-i nto-pract i ce  orientation,  which  describes 
research  and  theory  in  the  field.  Instructional  technologists 
are  theory-i nto-prac t i ce  scholars  for  the  most  part.  We  generate 
applied  research.  An  analysis  of  the  mul t i -dimensi onal  solutions 
may  suggest  more  intellectual  dimensions. 
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In  order  to  produce  complete  results,  much  more  data  needs  to  be 
collected  and  analyzed.  That  logistics  oi  such  a  project  are  far 
more  problematic  than  anticipated.  This  has  become  a  pilot 
project  of  sorts.  If  possible  to  complete  a  final  project,  we 
should  be  able  to  empirically  generate  a  conception  of  our  field. 
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TWO  DIMENTIONAL  CONCEPT  SCALING 


DERIVED  STIMULUS  CONFIGURATION: 
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Introduct  i  on 


Probl em 

Videodiscs  are  most  commonly  produced  in  the  -form  o-f  generic 
discs,  ie.  generic  collections  o-f  still  and  motion  video  to 
support  instruction  in  a  -field  o-f  study.  The  best  instructional 
application  o-f  generic  discs  is  as  instance  pools  -for  concept 
lessons.  Concept  lessons  depend  upon  a  large,  diverse  collection 
o-f  examples  to  provide  enough  o-f  the  matched,  divergent  example 
sets  needed  -for  concept  teaching  (Merrill  &  Tennyson,  1977).  The 
thousands  o-f  images  available  on  most  generic  discs  <eg.  the 
Bioscience  or  National  Gallery  o-f  Art  videodiscs)  make  them  ideal 
instance  pools.  What  is  needed  in  order  to  -facilitate  the  use  o-f 
generic  discs  as  instance  pools  are  good  lesson  templates  -for 
helping  experienced  and  especially  inexperienced  designers  to 
deve 1  op  these  concept  1 essons. 

Concept  Lesson  Template 

A  useful  template  must  be  based  upon  good  instructional 
design  theory.  Many  models  o-f  concept  -formation  are  available 
(Millward,  1988).  Probably  the  most  popular  among  instructional 
designers  is  the  Rul  e-Recal  1 -Exampl  e-Pract  i  ce  presentation  o-f 
concept  de-finitions  based  upon  exposition  o-f  the  critical  and 
variable  attribute  dimensions  (Merrill  &  Tennyson,  1977). 
Problems  "o-ften  occur  in  applying  this  model  to  **rea1  world" 
concepts,  so  Tennyson  and  Cocchiarella  <1984)  have  provided  an 
empirically  based  instructional  design  theory  -for  concept 
instruction  that  is  use-ful  -for  developing  a  template.  Their 
theory  asserts  that  conceptual  knowledge  does  not  result  -from  the 
memorization  and  application  o-f  de-fining  criteria,  but  rather 
concepts  are  coded  into  memory  as  prototypes.  Prototypes  are 
abstractions  o-f  typical  class  members.  Procedural  knowledge  o-f 
concepts  is  -formed,  as  in  expository  instruction,  by  practice  and 
-feedback.  In  order  to  veri-fy  the  prototype  theory,  Tennyson  and 
others  (1983)  compared  the  -formation  o-f  prototypes  generated  -from 
seeing  prototypic  examples  with  cl  assi -f  i  cat  i  on  -from  a  list  o-f 
de-fining  attributes.  In  the  prototype  group,  third  graders 
compared  each  instance  in  the  set  with  a  prototype  or  "best 
example"  o-f  the  concept,  while  the  students  in  the  attribute-list 
groups  evaluated  each  instance  -for  the  presence  o-f  critical 
attributes.  On  immediate  and  delayed  classification  tests,  the 
protoype  groups  ou tper-f ormed  the  attribute  groups. 

Park  (1984)  corroborated  these  results  when  he  compared  an 
expository  attribute  isolation  strategy  <AIS)  with  a  niore 
generative  example  comparison  strategy  (ECS).  The  AIS  group  o-f 
twel-fth  graders  used  a  list  o-f  attributes  while  classi-fying 
interrogatory  instances.  The  F"S  group  compared  a  best  example 
with  each  o-f  the  interrogatory  i  nstances  wh  i  1  e  classi-fying  them. 
In  the  ECS  group,  learners  elaborated  their  own  prototypes  as 
decision  criteria  in  cl  assi -f  i  cat  i  on  tasks,  while  the  AIS  group 
used  an  external  1  y-prov  i  dt  J  set  o-f  analytic  attributes.  The  AIS 
1  earners    cl  assi  -f  i  ed    more    accurately    during    the  instructional 
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program,  but  their  classification  ability  decreased  significantly 
on  the  retention  test.  That  the  ECS  group  retained  their 
ability  longer  indicated  that  thair  elaborations  produced  a  more 
durable  conceptual  knowledge. 

The  AIS  and  ECS  tempi ates  were  compared  in  a  videodisc-based 
concept  1  esson  <  Jonassen ,  1986>  wh  i  ch  -found  no  di  -f-f  erence  in 
concept  acqu  i  si  t  i  on  or  retent i  on .  The  prototype  treatment 
compared  each  new  instance  with  a  set  oi  three  best  examples 
while  the  attribute  identification  treatment  presented  the  list 
of  critical  attributes.  In  order  to  distinguish  empirically 
between  conceptual  knowledge  and  procedural  knowledge,  it  is 
neccessary  to  compare  the  effects  of  prototype  development  with 
and  without  practice. 

Another  instructional  strategy  that  would  likely  improve  the 
development  of  prototypes  (conceptual  knowledge)  is  an 
elebaoration  learning  strategy  that  forces  learners  to  articulate 
their  own  prototypes.  Jonassen  <1985>  promoted  the  inclusion  of 
learning  strategies  in  courseware  to  deepen  the  level  of 
processing  by  learners.  Previous  prototype  research  (Park,  1984) 
compared  prototype  development  with  checkoff  of  an  attribute  list 
which  was  not  a  generative  activity.  What  if  learners  generated 
their  own  attribute  list  for  each  concept?  Such  a  strategy 
should  produce  deeper  processing  which  should  positively  affect 
the  development  of  conceptual  knowledge. 

Purpose  of  Study 

The  prototype  model  of  concept  acqu  i  si  t  i  on  is  gai  n  i  ng 
general  acceptance.  What  is  not  clear  in  that  model  is  the  role 
of  conceptual  knowledge  and  procedural  knowledge  in  the  prototype 
model.  Tennyson  et  al  <1?81>  showed  that  adding  practice  with 
new  instances  to  expository  instruction  improved  cl  assi  f  i  ce.t  i  on 
ability.  In  this  study,  we  compare  protoype  instruction  with 
prototype  +  interrogatory  instances  (practice).  In  order  to 
assess  the  kinds  of  prototypes  that  learners  develop,  a  third 
learning  strategy  treatment  was  added.  In  this  study,  we  ask 
learners  to  use  a  combination  of  imagery  and  paraphrasing 
strategies  to  elaborate  the  prototype  they  develop. 

METHOD 

Part  i  c  i  pants 

I  Thirty  volunteer  graduate  students  in  education  programs  at 
two  universities  were  randomly  assigned  to  one  of  thf*ee  treatment 
groups  and  completed  the  study. 

Instruct  i  onal  Mater  i  al s 

Three  treatments  of  an  interactive  video  lesson'on  "Styles  of 
Art**  comprised  this  coordinate  concept  lesson,  featuring  the 
Rennai ssanre ,  Baroque^  Impressionistic  and  Post-Impressionistic 
styles  of  art.  Baroque  and  Renaissance  and  Impressionistic  and 
Post-Impressionistic  are  close-in  example/non-example  sets,  while 
each  pair  are  far-out  non-examples  for  the  other  (Merrill  & 
Tennyson,     1977).     Close-in    non-examples    are    more  difficult  to 
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discriminate  -from  one  another,  resulting  in  a  tendency  to 
overgeneral ize.  The  pretest,  posttest,  retention  test,  and 
instance  pool  required  a  ra'tional  set  o-f  25  instances  o-f  each 
style  o-f  art.  The  set  O'f  examples  came  -from  the  National  Gallery 
O'f  Art  disc,  which  consists  O'f  a  motion  tour  and  art  lesson  and 
3300  stills  O'f  1400  works  o-f  art  in  the  collection.  The  computer 
program  is  written  -for  an  Apple  He  driving  a  Pioneer  LD-V^2000 
player  through  an  Allen  WI   inter-face  card. 

Treatmen  ts 

All  treatments  included  a  15-item  pretest  and  posttest  consisting 
o-f  randomly  sequenced  sets  o-f  three  examples  o-f  each  style  plus 
three  distractors.  Following  the  pretest,  text  was  used  to 
introduce  the  coordinate  concept  o-f  styles  o-f  art.  The 
treatments  were  presented  next,  -followed  by  the  posstest. 

The  prototype  only  presentation,  providing  only  the  concept 
knowledge  development  phase  o-f  concept  acquisition,  consisted  o-f : 
1>  For  each  style  o-f  art,  the  name  o-f  the  style  was  -followed  by 
three  best  examples  (archetypical  examples  o-f  that  style). 
Participants  were  instructed  to  try  to  develop  their  own 
de-finition  o-f  the  style. 

2>  A  rational  set  o-f  16  was  presented  as  examples.  A-fter  each  10 
second  presentation,  one  best  example  o-f  each  style  was 
presented.  The  participant  decided  which  o-f  the  -four  best 
examples  most  closely  resembled  the  example  in  terms  o-f  style. 
Knowledge  o-f  results  was  provided  a-fter  each  example. 

The  prototype  'f  practice  presentati'  >,  providing  -for  the 
development  o-f  conceptual  knowledge  p  ^  procedural  knowledge, 
consi  sted  o-f  : 

1>  same  as  the  previous  treatment,  plus 

2>  Ten  additional  practice  items  without  prompting,  -followed  by 
knowledge  o-f  results. 

The  prototype  "f  elaboration  practice  pre^en  tat  i  on  ^  providing 
-for  development  plus  elaboration  o-f  conceptual  knowledge  plus 
procedural  knowledge,  consisted  o-f: 

1>  the  same  treatment  as  in  the  prototype  +  practice,  plus 
2>  A-fter  each  set  o-f  best  examples  was  presenteJ,  the  screen  was 
blanked  and  the  participdint  was  asked  to  close  their  eyes  and 
-form  a  mental  image  o-f  that  style  o-f  painting  and  then  to  type 
into  the  computer  5"  least  three  characteristics  o-f  that  style  o-f 
painting.  This  imagery/paraphrasing  strategy  should  improve 
conceptual  development  and  improve  practice  ^nd  posttest 
c  1  assi  -f  i  cat  i  on  accuracy. 
Measuremen  t 

The  dependent  variables  included  posttest  and  retention  test 
cl  assi -f  i  cat  i  on     accuracy.  The      retention      test      was  taken 

individually  using  the  same  con-figuration  as  in  the  treatment. 
The  retention  test,  like  the  pretest  and  posttest,  consisted  o-f 
15  items  <3  o-f  each  style  +  3  distractors). 
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Results  and  Discussion 


The  pretest  scores  -for  'each  of  the  groups  (see  Table  1  for 
group  means)  were  not  significantly  different,  F<2>=2.e6,  e.>.05# 
Posttest  scores,  however,  wore  significantly  different, 
F<2>«6.06ffi.<.ei .  A  Fisher^s  Least  Significant  Difference  Test 
showed  that  the  prototype  only  (control)  group  scores  differed 
significantly  from  both  of  the  other  treatment  groups.  However, 
the  prototype+pract i ce  and  prototype+prac t i ce+el aborat i on  groups 
were  not  significantly  different.  A  bug  In  the  computer  program 
wh  i  ch  dr  i  ves  the  v  i  deo  pi  ayer  prevented  the  correl  at  i  on  <jf 
retention  test  data  to  the  other  scores  ^s  well  as  eliminating 
several  student  scores,  so  only  the  immediate  posttest  data  for 
38  subjects  was  available  for  analysis. 

In  ^rder  to  factor  prior  knowledge  of  the  subject  mattc-r, 
we  conducted  a  repeated  measures  (or^*  n  by  pretest/posttest) 
analysis  of  variance.  The  analysis  <wed  significant  main 
effects  for  xhe  repeated  me^isure,  Fs .  .«62.36,fi,<  •891 .  It  is 
obvious  from  the  mean  pretest  and  posttest  scores  that  learning 
did    take      place.  The    mf\in      effect     for    group  approached 

significance,  F(2>=2.63,fi.=.08.  The  urivariate  analysis  showed 
that  the  practice  and  pract i ce+el aborat I  on  groups  differed 
significantly  from  the  control  group  on  the  posttest  but  did  not 
differ  between  them.  The  change  score  (posttest-pretest)  was 
higher  for  the  pract 1 ce+el aborat i on  group  (M-5.5>  than  for  the 
practice  group  <M==3.8>. 

The  prototype  treatments  obviously  produced  learning  during 
the  lesson.  Practice  has  consistently  been  shown  to  improve 
concept  learning  (Tennyson  et  al  ,  1981).  k^irtual  1y  all  of  the 
mathemagenic  literature  supports  that  conclusion  as  well.  Of 
greatest  interest  to  this  study  was  the  effect  of  performing  the 
elaboration  strategy.  This  type  of  strategy  forces  learner^s  into 
deeper  processing.  The  results  indicated  a  trend  in  favor  of  the 
elaboration  strategy  group.  The  loss  of  several  subjects  in  the 
analysis  probabl i st 1 cal 1 y  affected  those  results.  Wo  will  run 
additional  subjects  this  winter  and  reanalyze  thc^  data. 

The  major  unknown  from  this  study  is  the  effect  of  different 
treatments  on  retention  scores.  Previous  research  (Jonassen, 
1986;  Park,  1984)  has  shown  that  the  prototype  concept 
acquisition  strategy  Is  less  susceptible  to  decay  on  retention 
tests.  The  elaboration  strategy,  if  It  In  fact  stimulates  deeper 
processing,  should  produce  even  more  resistant  performance.  Long 
term  retention  Is  normally  positively  affected  by  deeper 
processing.  Additional  subjects  should  clarify  this  and  other 
remaining  questions. 
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Group  Means 


Prototype 
Only 


Prototype  + 
Pract  i  ce 


Prototype  + 
Practice  + 
El aborat  i  on 


Pretest 


6.9 
<2.3) 


7.6 
<1.9) 


5.6 
<2.6) 


Posttest 


8.7 
<2.3) 


11.4 
<1.8) 


11.1 
<1  .4) 
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•.••our  language  promotes  a  view,  a  way  of 
looking  at  things ,  as  well  as  a  content  to  be 
observed*  This  language,  I  am  arguing »  derives 
from  a  set  of  images,  of  what  schools  should  be, 
of  how  children  should  be  taught,  and  of  how  the 
consequences  of  schooling  should  be  identified. 
Language  serves  to  reinforce  and  legitimize  those 
images.  Because  differences  between,  say,  terms 
such  as  instruction  and  teaching  are  subtle,  we 
often  use  a  new  word  without  recognizing  that  the 
new  word  is  caji^le  of  creating  s  new  world. 
(Eisner,  1985,  p. 355) 

The  power  of  words  (languaging)  is  probably  the  roost  overlooked,  least 
understood,  and  ultimately  most  neglected  phenomenon  in  the  field  of  education. 
Words  serve  to  produce  a  paradoxical  situation:  words  can  both  "freeze"  and 
"unfreeze"  resdity.  It  is  my  contention  that  the  language  of  the  dominant 
paradigni  for  educatioial  thou^t  tends  to  provide  more  of  a  "freezing" 
function. 

This  paper  has  a  dual  purpose.  First,  I  present  a  brief  descripticxi  and 
critique  of  tJie  dominant  model  of  schooling.  Secondly,  I  offer  an  alternative 
paradigfTi  for  analyzing  school  practice.  The  freezing  of  educational  reality  can 
be  -^en  dn  the  almost  exclusive  use  of  a  technical-x^ational^  management  model  of 
schc  practice,  based  on  behavioral,  positivistic,  quasi-scientific  language. 
This  has  become  the  dominant  way  of  perceiving  and  talking  about  schooling.  The 
current  emphasis  and  obsession  with  students*  scores  on  standardized  tests  has 
shifted  attention  from  the  art  and  craft  of  teaching  to  the  "science  and 
technology"  of  teaching.  This  has  primarily  taken  the  form  of  perceiving  and 
talking  about  schooling  from  an  effective  schools/ teaching  model  (Hunter,  1984; 
Lazotte  &  Bancroft,  1985).  Another  example  of  this  model  is  found  in 
management/systems  thinking  applied  to  the  instructional  process  ;  a 
reductionist  view  of  the  teaching/ learning  process  which  severely  limits  ways  of 
looking  at,  talking  about  and  living  with  students.  (1) 

An  alternative  model  for  analyzing  school  practice  is  offered  by  Elliott 
Eisner  •  s  ( 1985a)  notion  of  educational  connoisseurship  and  educational 
criticism.  I  will  argue  that  Eisner  •s  aesthetic  paradigim  can  provide  education 
a  broader  conceptual  base  from  which  to  work  in  better  understanding  the 
co-nplexities  of  the  schooling  process.  This  conceptual  base  givese  educators  a 
more  diverse  language  system  for  understanding  and  interpreting  what  they  see, 
and,  vice  versa,  what  th^y  see  and  observe  is  not  limited  to  forms  of 
expression  that  use  technical  language. 
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The  litfKrrta  ce  of  examining  the  language  base  of  educational 
paradigms/models  cannot  be  over  stressed.  Educators  use  and/or  Invent  words  to 
serve  as  tools  and  their  perceptions  become  controlled  by  these  creations. 
Language  which  is  Intended  to  explain,  or  describe  reality,  becomes  reality.  What 
can't  be  explained  (or  programmed  into  a  computer)  is  too  often  Ignored  and 
ultimately  dismissed.  I  am  arguing  that  the  way  we  talk  about  a  phenomenon 
determines  what  we  see  before  we  look.  The  language  of  a  field  encourages  human 
encounters  to  be  a  priori.  If  we  are  to  pursue  the  reality  of  the 
teaching-learning  act,  educators  must  ;ucover  the  meanings  of  words  blurred  ty 
custom  and  usage  and  be  willing  to  examine  the  conceptual-base  of  their  views  of 
school  practice. (2) 


The  Dominant  Paradigm  of  Schooling 


Wanting  teachers  to  be  effective  and  competent  seems  to  be  a  reasor^le 
expectation.  However,  designing  the  means  of  determining  teaching  effectiveness 
and  teacher  competency  becomes  complex.  Traditionally,  the  major  tVirust  in 
teaciilng  effectiveness  and  teacher  competency  studies  has  been  an  emphasis  on 
designing  research  studies  that  focus  on  the  technical  and  political  aspects  of 
the  teaching-learning  experience.  Basically,  this  research  Includes  studies 
concerned  with  various  instructional  methodologies  and  pupil  achievement 
(Fisher,  ffarlave,  &  Fllby,  1979;  Good,  Biddle,  &  Brophy,  1975;  Russell  &  Fea, 
1963),  teacher  characteristics  and  teaching  effectiveness  (Coker,  Medley,  & 
Soar,  1980;  Getzels  &  Jackson,  1963;  Raskow,  Alraslon,  &  Madaue,  1978),  and 
teacher  behaviors  as  related  to  pupil  achievement  (Good,  1979;  Rosenshine,  1976; 
Wlthall  &  Lewis,  1963). 

In  these  paradigms  for  i^tudylng  teaching  effectiveness  and  teacher 
competency,  little  attention  is  focused  on  the  nature  of  the  research  questions 
or  v*iy  they  were  posed.  To  be  satlsfi  d  with  asking  the  right  research  question 
is  not  enough.  Responsible  educatoi^s  must  ask  why  the  question  was  asked  and 
why  it  was  phrased  in  a  particular  manner.  The  scope  and  nature  of  research 
questions  cannot  be  neglected.    Scientific  Investigation  is  not  value-neurtal. 

A  possible,  and  often  overlooked,  explanation  causing  the  study  of  teaching 
effectiveness  to  follow  technical  lines  of  investigation  may  be  the  language  of 
teaching.  The  power  of  language  to  Influence  or  direct  the  study  of  teaching  is 
supported  by  Soltis  (1973) ,  v^o  suggests  that  a  conplex  educational  system 
develops  a  specialized  voacbulary.  Educational  words  have  power — the  power  to 
direct  the  procedures  suid  purposes  of  researchers.  Typical  words  used  in 
research  on  taaching  effectiveness  are  behavior  (student  and  teacher), 
effectiveness,  personality,  achievement,  outcomas,  interaction,  characteristics, 
behavioral  measurements,  and  performance.  More  recently,  the  literature  is 
using  such  words  as  direct  instruction,  time  on  task,  assignments,  expectations, 
monitoring,  pupil  task  involvement,  seat  work,  and  a  v*iole  host  of  terms 
reflecting  technical  and-  political  value  bases.  The  metaphorical  bases  of  these 
words  are  industrial,  military,  and  disease  (medical).    For  example: 

Industrial  -  classroom  management,  cost  effectiveness, 
efficiency,  institutional  planning, 
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progrannlng,  output  measures,  product, 
feedback,  defective,  lnput-process> 
output,  quality  control,  time 
management. 

Military  -    target  population,  infonnation  system, 
centralization  of  power,  line  and  staff, 
scheduling,  discipline,  objectives, 
teacdiing  strategies,  mcintain. 

Disease  -      diagnosis,  treatment,  prescription, 
remediation,  monitor,  label,  deviant, 
impaired,  referral-procedure,  special 
needs. 


These  metaphors  encourage  teaching-learning  research  to  be  viewed  and 
investigated  from  a  technical  perspective.  Researchers  invented  words  to  serve 
as  tools  and  now  they  are  controlled  by  these  tools.  Language  which  is  intended 
to  explain  or  describe  resdity  too  often  becomes  the  reality.  What  cannot  be 
explained  with  language  is  often  ignored  and  ultimately  dismissed.  As  mentioned 
earlier,  words  serve  to  produce  a  paradoxical  situation,  namely,  the  freezing 
and  unfreeisihg  of  reality.  This  is  due  to  the  tedinical  en?5hasis  on  defining 
terms,  along  with  the  emphasis  on  observable  behavior  to  explain  the  hunan 
condition.  If  researcdiers  are  to  pursue  the  roots  of  reality  relative  to 
teadiing-leaming,  they  must  uncover  the  meaning  of  words  blurred  by  custom  and 
usage.  Researdiers  of  teaching  effectiveness  are  affected  by  language  and,  more 
often  than  not,  their  research  efforts  reflect  the  posed  meaning  these  words 
possess. 

As  expressed  by  Filmier  (1972,  p.  13),  there  are  languages  of  conditional 
relationships  and  relationships  "without  conditions":  the  first  is  a  language 
of  "caitrol";  the  second  is  a  language  of  "love  and  growth,"  One  laas  to  wonder 
if  teaching  effectiveness  has  as  its  priority  control  or  learning  (love  and 
growth).  Roberts  (1976,  p. 321)  echoed  this  sentiment  when  she  wrote,  "It  is 
Impossible  to  practice  the  ideas  of  Skinner  and  Chomsky  simultaneously." 

Heubner   (1966)   discusses  the  dangers  involved  in  the  languaging  activity. 
He  refers   to  the  language  ol  the  technical  model  in  education  as  the  prevailing 
focus  during  the  past  few  years.   Heubner,  according  to  Macdonald  (1977,  p. IS), 
"...opens  the  possibilities  of  political,  aesthetic,  and  moral  talk." 

The    language  of  the   technical  model  anplied  to  teaching  effectiveness 

research  .has  contributed,  to  a  ^simplistic,  input/output,  unc^arstanding  of 
educational    experiences  .  ("student-as-product"  orientation).     The  technical 

model,   along  with  the  technical-ratir>nal  language,  suggests  that  the  "right  mix" 

of  tedmique  and  content  will   significantly  increase  student  performance. 

Teaching  is  viewed  as  a  "science  and  techiiiology"  with  identifiable  skills 

lending  themselves   to  short-term  teadiing  goals  that  focus  on  a  utilitarian 

perspective.     Tabachnick,   Popkowitz  and  Zeichner   (1979-80)  suggest  that  this 

leads  to  a  managerial  understanding  of  teaching. 

The  language  of  the  technical  model  applied  to  teaching  effectiveness 
suggests  scientific  accuracy  and  predictability,  and  the  nature  of  this  model 
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°!Lv^2!*.  outlined  by  others  (Apple,  1979;  Giroux,  19P0; 

^i^^USIf'    Ttoachnick  et  al.  (1979-80,  p.  16),  in  their  research  on  thi 
s^Jdent-teachlng:  experience,  observed  student  teachers  engaged  in  the  "routine 
teaching  of  precise  and  short-term  skills  and  in  management 
activities  designed  to  keep  the  class  quiet,  orderly,  and  on  task." 

^  the  teaching  profession  h.>s  become  an  increasingly  highly  skilled 

technology  with  a  primary  emphasis  on  methods  and  outcomes,  teachers  have  been 
rewarded  for  guiding  their  practice  in  ways  amenable  to  this  technology.  As 
Macdonald  suggests  (1975),  this  notion  implies  that  "teachers  are  potentially 
interchangeable,"  and  leads  to  viewing  productive  activity  as  something  learned 
and  performed  "mechanistically."  Thus,  any  "good"  teaching  activity  can  be 
reproduced  by  any  other  teacher,  arid  "...all  productive  teaching  is  measureable 
in  terms  of  the  criteria  of  the  accountability  in  use"  (pp.79-80). 

.'\pple   (1982)   refers   to  this  as  a  process  of  "deskillirig-reskillinc" 
teachers:  * 

As  the  procedures  of  technical  control  enter  into 
the  school  in  the  guise  of  pre-designed 
curricular/ teaching/evaluation  'systems,'  teachers 
are  being  deskilled.  Yet  they  are  also  being 
,  reskilled  in  a  way  that  is  quite  consequential. 
...while  the  deskilling  involves  the  loss  of 
craft,  the  ongoing  atrophication  of  educational 
skills,  the  reskilling  involves  substitution  of 
the  skills  with  ideological  visions  of  management. 
(p.256) 

Tom  (1977)   contends  that  what  is  lacking  in  the  managerial  perspective  is 
the  acamowledgment  of  interpersonal  or  social  relationships: 

...these  relationships  cannot  be  reduced  to  a 
collection  of  techniques  without  debasing  them  and 
stripping  them  of  their  humanity.  However,  even 
if  one  rejects  this  humanistic  concern,  there  is 
another  fundamental  problem.  A  technology  must 
have  definite  ends  toward  v^ich  its  activity  is 
aimed.  There  is,  of  course,  no  long-term 
consensus,  on  the  aims  of  education,  (p. 78) 

The  lack  of  consensus  on  the  aims  of  education  within  the  technical  model 
IS  not  viewed  as  problematic  because  there  are  cormionsense  ividerstandings  of 
purpose  within  the  model.  The  position  here  becomes  one  of  value-neutrality, 
tmt  is,  teaching  &nd  learning  as  apolitical. 

Giroux  (1980)  suggests  that  the  political  nature  of  education  programs  is 
seen  in  the  language  used  to  address  everyday  school  practices.  Stating  that 
teacher  education  programs  serve  as  socializing  agencies  enbodying  "...rules  and 
patterns  for  constructing  and  legitimizing  categories  regarding  competence, 
achievement,  and  success,"  (p.8)  he  suggests  that  this,  in  turn,  serves  to 
define  specific  teacher  roles 
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...through  the  language  they  use  and  the 
assumptions  and  researdi  they  consider  essential 
to  the  teadilng  profession.  The  basic  premises 
and  rules  that  underlie  such  programs  usually 
viewed  as  commonsence  perceptions;  they  go 
unquestioned  and  often  result  in  many  problems  in 
the  teaching  arena  to-  be 
defined  as  basically  tedinical  areas. 

In  the  same  vein,  Foshay  (1980)  proclaims  the  importance  of  language  and 
its  linkage  to  practice.   He  states: 

It  is  scarcely  recognized  the  way  we  talk  and 
think  has  a  controlling  effect.  Behind  our 
manifest  language  is  a  metaphor  which  carries 
latent  meanings  to  events.  Behind  our  action  is 
also  theory  about  the  domain  of  action,  (p. 82) 

Fogy's  contention  provides  a  clear  picture  of  how  theory  and  practice, 
talk  and  actic»i  are  underlying  sequences  in  everyday  events  and,  quite  possibly, 
research  efforts.   Ifaplin  (9169)  lends  support  v*ien  he  states: 

But  if  the  word  is  only  as  good  the  idea  behind 
it,  we  as  educators  should  ask  questiois  more 
frequently  than  we  do,  not  Just  what  this  or  that 
educational  word  means,  but  to  vrfiat  assunptions, 
values,  theories,  procedures,  and  strategies  for 
teaching  do  these  words  commit  us.  (p.335) 

Certain  words  used  in  teaching-learning  research  help  us  to  "see"  teaching 
effectiveness  in  a  certain  way,  or  ways  of  "seeing"  teaching-learning  liave 
generated  certain  language  systems.  Casual  priority  does  not  seem  particularly 
important  here.  What  is  Inportant  is  the  current  language  used  connotes  a 
simplistic  tecdviical  view  of  teaching-learning. 


Discussion 

The  nonr-neutrality  of  methods  of  inquiry  has  been  argued  by  Habermas  (1971) 
(3).  Educators  have  argued  the  nonnieutrality  of  education  as  a  process  (e.g. 
Apple,  1979;  Aronowitz  &  Giroux,  1986;  Dobson,  Dobson,  &  Koetting,  1985;  Eisner, 
1985a  &  1985b;  Freire,  1970;  etc.).  However,  the  encouraged  model  of  perception 
in  teaching  is  one  of  value-neutrality  in  the  form  of  observation.  Certain 
behavioral  characterictics  of  children  are  classified  and  labeled  and  teachers 
are  trained  to  see  these.  This  activity  has  resulted  in  the  field  of  teacher 
education  abounding  with  an  "if-then"  mentality,  a  reduction  of  the  cause-effect 
model  borrowed  from  natural  science.  If  a  child  exhibits  a  certain  behavior, 
then  an  appropriate  treatment  is  prescribed.  Apple  (1979)  argues  that  educators 
have  borrowed  a  reconstructued  logic  of  science  and  applied  it  to  curriculum  and 
pedagogicail  research  and  practice. 

Pattern?  of  thougjit  or  the  usage  of  language  schemes  borrowed  from  the 
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natoaal  scleneesf  slraply  do  not  fit  suntnarily  the  social  sciences.  Exactness  and 
prviClsioh  are  needed  v*ien  dealing  with  things  (natural  sciences)  for  purposes  of 
prediction  and  control.  However,  lattitude  and  flexibility  are  needed  when 
dealing  with  humans  for  purposes  of  growth,  emancipation,  and  understanding. 

Apple  (1975a)  contends  that  "...two  major  problems,  in  education 
historically  have  been  our  inability  to  deal  with  ambiguity,  to  see  it  as  a 
positive  characteristic,  and  our  continual  pursuit  of  naive  and  simplistic 
answers  to  complex  human  dilerams"  (p. 127).  He  continues  by  suggesting  that 
phawroenolQgists  seek  to  cast  aside  ttieir  previous  perceptions  of  familiar 
objects  and  attempt  to  reconstruct  them.  The  work  of  the  phenomenologist  is  to 
see  the  phenomenon  as  it  is  rather  than  as  it  is  suggested.  Ttie  basic  question 
becomes  one  of  whether  or  not  "familiar"  educational  constructs  for  viewing  and 
speaking  of  children  are  adequate  relative  to  the  potential  of  children. 

The  consequences  of  an  over-reliance  on  a  technical-rational,  scientific, 
management  model  for  viewing  the  process  of  schooling  have  been  nunerous.  So, 
too,  the  impact  of  the  language  used  in  this  model.  Eisner  (1985a)  identifies 
six  consequences  that  he  sees  as  most  important.  The  first  consequence  is  that 
a  "scientific  eplstemology"  dominates  as  the  only  legitimate  means  of 
educational  Inquiry.  All  other  views  are  excluded  (p.  17).  Secondly,  this 
"scientific  eplstemology"  in  education  is  preoccupied  with  control.  This  has 
resulted  in  iatteinpts  at  developing  "teacher  proof"  curriculum  materials  and, 
diagnostic/prescriptive  models  of  teaching  (pp.  17-18).  A  third  consequence  is 
a  preoccupation  with  "standardized  outcomes,"  manifested  in  the  current,  "testing 
movement"  and  teacher  accountability/effectiveness  (p.l9).  Fourth,  students 
have  no  role/participation  in  developmlng  educational  programs  because  "the 
provision  for  such  opportunities  would  make  the  system  difficult  to  control, 
hard  for  educators  to  manage,  and  complex  to  evaluate"  (p.  19).  A  fifth 
consequence  is  fragmenting  the  curriculum.  This  results  in  breaking  up  complex 
tasks  into  smaller,  "almost  microunits  of  behavior  and  in  the  process  to  render 
much  of  the  curriculum  meaningless  to  children"  (p.20).  A  sixth  consequence  is 
that  educational  language  has  become  an  "emotionally  eviscerated  form  of 
expression;  ary  sense  of  the  poetic  or  the  passionate  must  be  excised.  Instead, 
the  aspiration  is  to  be  value  neutral  and  technical.  It  is  better  to  talk  about 
subjects  than  students,  better  to  refer  to  treatment  than  to  teaching,  better 
to  measure  than  to  Judge,  better  to  deal  with  outputs  than  results"  (p. 20). 

A  way  to  address  the  limitations  and  consequences  of  the  technical  model 
Identified  by  Eisner  is  to  reconceptualize  the  schooling  process.  For  example, 
Eisner  (1985a)  states  that  we  need  educational  theory  that  "unapologetically 
recognizes  the  artistry  of  teaching"  (p.22);  that  we  need  to  develop  "methods 
that  will  help  us  understand  the  kind  of  experience  children  have  in  school  and 
not  only  the  kind  of  behavior  they  display"  (p.22).  To  gain  an  appreciation  of 
educational  experience  will  require  methods  of  analysis  and  language  forms  that 
are  different  from  the  technical  model.   What  the  study  of  education  needs 

...is  not  a  new  orthodojqr  but  rather  a 
variety  of  new  assumptions  and  methods  that  will 
help  us  appreciate  the  richness  of  educational 
practice,  that  will  be  useful  for  revealing  the 
subtleties  of  its  consequences  for  all  to  see 
(Eisner;,  p. 23). 
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Fk^fesslorals  must  deal  not  only  with  yihat  they  see  but  with  why  they  see 
what  thv  see  (Dobeon,  Dobson,  &  Koetting,  1985).  The  way  educators  look  at 
(perceive),  talk  about  (leuiguage),  and  live  with  (experience)  children  is  an 
area  worthy  of  critical  analysis.  The  remainder  of  the  paper  explores  one 
alternative  framework  for  viewing  sdioollng  that  adresses  the  consequences  of 
Eisner,  that  allows  for  the  complexities  of  schooling  and  that  accepts  the 
interplay  of  perception,  language  and  values  that  are  at  work  in  looking  at 
schooling. 


An  Alternative  Perception  of  the  Practice  of  Schooling 

The  inherent  limitations  of  the  technical  model  of  schooling  and  its 
attended  language  system  cannot  be  over  come  by  "fine-tuning"  the  model.  What 
is  needed  is  an  alternative  conceptual  base  for  looking  at  and  talking  about 
schooling.  One  such  alternative  model  with  an  attended  language  system  is 
Elliot  W.  Eisner's  notice  of  educational  ccxmoisseurship  and  educational 
criticism.  Eisner  (1985a)  states  that  "this  form  of  educational  inquiry,  a 
species  of  educational  evaluaticxi,  is  qiialitative  in  character  and  takes  its 
lead  from  the  work  that  critics  have  done  in  literature,  theater,  film,  music, 
and  the  visual  arts"  (p. 216). 

Eisner  (1985a)  contends  that  there  are  two  forms  of  qualitative  inquiry  in 
the  arts.  Artists  use  a  qualitative  form  of  inquiry  when  they  become  involved 
In  making  statements  about  reality  ttirough  their  art.  The  result  is  a 
"qualitative  vrtiole  -  a  ^yn^Dhcxy ,  poem,  painting,  ballet  -  that  has  the  capacity 
to  evdce  in  the  intelligent  percipient  a  kind  of  experience  that  leads  us  to 
call  the  v;*v:<  art"  (p.217).  This  is  one  form  of  qualitative  inquiry.  The 
second  form  is  found  "in  the  work  of  those  who  inquire  into  the  work  of  artists, 
namely  the  art  critics.  The  art  critic  finds  himself  or  herself  with  the 
difficult  task  of  rendering  the  essentially  ineffable  qualities  constituting 
works  of  art  into  a  language  that  will  help  others  perceive  the  work  more 
deeply"  (p.217). 

The  critic's  work  is  to  be  a  "midwife  to  perception",  i.e.  he/she  must  use 
their  kno^/ledge  (connoisseurship)  to  make  puhlic  the  qmlities  that  make  up  the 
work  of  art  so  that  others  may  see  the  work  more  comprehensively.  The  critic's 
task  is  not  to  pass  judgfnent,  but  to  lift  "  the  veils  that  keep  the  eyes  from 
seeing"  (Eisner,  1985a,  p.217).  Thus  criticism  is  defined  as  the  "art  of 
disclosure"  (p. 219) 

Eisner  identifies  two  important  points  about  criticism.  First  criticism  is 
ian  "empirical"  endeavor,  i.e.  "the  qualities  the  critic  describes  or  renders 
must  be  capable  of  being  located  in  the  subject  matter  of  the  criticism.  In 
this  sense,  the  test  of  criticism  is  in  its  instrumental  effects  on  the 
perceptiai  of  works  of  art"   (Eisner,    1985a,  p.217).   Thus  criticism  aims  at 
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understanding  "qualities  and  their  relations^iips." 

The  second  point  Eisner  makes  about  criticism  is  that  "anything  can  be  its 
subject  matter."  Here,  Eisner  points  out  that  criticism  does  not  refer  to  "the 
negative  appraisal  of  something  but  rather  the  illumination  of  something's 
qualities  so  that  an  appraisal  of  its  value  can  be  made"  (1985a,  p.218).  Hie 
two  points  are  crucial  In  understanding  his  use  of  criticism  within  the 
educational  caitext,  because  although  educators  sometimes  refer  to  teaching  as 
an  art,  the  language  they  comrawily  use  in  describing  or  understanding 
educational  practice  is  not  criticism,  but  the  language  of  science  (usually 
qualitative,  enplrical  data). 

There  is  a  definite  relationship  of  educatiaial  criticism  to  educaticml 
connoisseurship.    Whether  within  the  arts  or  in  education,  effective  criticism 
is  an  act  dependent  on  the  powers  of  perception.   It  is  this  ability  to  see,  "to 
perceive  what  is  sbutle,  complex,  and  inportant"  that  is  the  necessary  condition 
for  criticism.     This  act  of   "knowledgeable  perception"   is  referred  to  as 
connoisseurship,   i.e.,   to  know  "how  to   look,   to  see,  and  to  appreciate." 
Camoisseurship  is  the  art  of  appreciation.     It  is  essential  to  criticism. 
Without  connoisseurship,  criticism  "is  likely  to  be  superficial  or  empty" 
(Eisner,  1985ai  p. 219). 

To  be  a  connoisseur  is  to  be  involved  in  the  art  of  appreciation.  To  be  a 
critic  is  to  be  Involved  in  the  art  of  disclosure.  Connoisseurship  is  a  private 
act,  consisting  in  the  recognition  and  appreciation  of  the  qualities  of  a 
particular,  requiring  neither  public  Judgment  nor  public  descripticai  of  those 
qualities.  Criticism,  on  the  other  hand,  is  "the  art  of  disclosing  the 
qualities  of  events  or  objects  that  connoisseurship  perceives.  Criticism  is  the 
public  side  of  connoisseurship.  One  can  be  a  connoisseur  without  the  skills  of 
criticism,  but  one  cannot  be  a  critic  without  the  skills  of  connoisseurship" 
(Eisner,  1985a,  p. 223).  Thus  connoisseurship  is  essential  to  critisism, 
providing  the  "fundamental  core  of  realization  that  gives  criticism  its 
naterial"  (Eisner i  1985a,  p.  220) 

Experience  in  classrooms  or  educational  settings  is  Important  to  developirjg 
educational  connoisseurship.  Yet  it  is  not  a  question  of  cumulative  experience 
in  classrooms.  More  important  is  the  perception  of,  or  "seeing"  the  experience, 
as  opposed  to  "looking"  or  recognition  of  the  experience  for  purposes  of 
classification.  Thus  the  connoisseur  must  i>ecorae  a  "student  of  human  behavior", 
seeing  subtleties  and  focusing  one's  perception,  attending  to  the  "essence"  of 
v*iat  is  occur ing.   To  attend  to  the  essence  of  an  event  requires 

...a  set  of  ideas,  theories,  or  models  that 
enable  one  to  distinguish  the  significant  from  the 
trivial  and  to  place  what  one  sees  in  an 
intelligible  context.  This  process  is  not  serial: 
we  do  not  see  and  then  assess  significance;  the 
very  ideas  that  define  educatiaial  virtue  for  us 
operate  within  the  perceptual  processes  to  locate 
among  thousands  of  possibilities  what  we  choose  to 
see.  The  essence  of  perception  is  that  it  is 
selective;  there  is  no  value-free  mode  of  seeing 
(Eisner,  1985a,  pp. 221-222). 
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In  other  wordSt  our  "perceptual  processes"  woric  within  an  "array  of  values  and 
theoretical  concepts  that  influence  perception"  (p.2Z2).  We  use  thesa 
theoretical  constructs  to  better  understand  and  interpret  our  worldy  and 
individuals  will  use  different  theories  to  explaia^interpret  the  same  reality. 

It  is  here  we  begin  to  understand  the  demands  placed  on  the  educational 
connoisseur/critic,  and  the  dynamic  interplay  between  the  two.  It  bears 
repeating  ttiat  connoisseurship  is  a  private  act,  criticism  is  a  public  act*  One 
can  be  a  connoisseur  and  not  be  a  critic*  But  one  cannot  be  a  critic  without 
being  a  connoisseur.  To  be  a  connoisseur  of  education  requir^as  "an 
understanding  of  different  social  sciences,  different  theories  of  education,  and 
a  grasp  of  the  history  of  education"  (Eisner,  1985a,  p.222).  The  educational 
o-.*itic  creates 


a  rendering  of  a  siti^ation,  event,  or  object  that 
will  provide  pointers  to  those  aspects  of  the 
situation,  event,  or  object  that  are  in  some  way 
significant.  Now  what  counts  as  significant  will 
depend  on  the  theories,  models,  and  values  allided 
to  earlier.  But  it  will  also  depend  on  the 
purposes  of  the  critic...  What  is  rendered  by 
someone  working  as  an  educational  critic  will 
depena  on  his  or  her  purposes  as  well  as  the  kinds 
of  maps,  models,  and  theories  being  used.  (Eisner, 
1985a,  pp.223-224) 


The  notion  of  rendering  is  iinportant  here,  and  again,  the  interplay  between 
connoisseurship  ar^d  criticism  is  evident.  Hie  critic  attempts  to  render,  or 
translate  into  another  language,  to  bring  out  the  meaning  of,  to  interpret 
qualities  of  something  (an  object,  an  event  or  experience,  etc.),  to  disclose 
something  that  mig^t  not  be  evident.  The  critical  Importance  of  language  comes 
into  play  here,  and  the  distinction  between  discursive  and  non-discursive  forms 
of  expression  is  critical. 

The  tedinical-rationed  model  discussed  earlier  in  this  paper  severely 
limits  the  discourse  about,  and  interpretation  of,  educational  events.  The 
limitation  comes  from  the  language  system  it  uses,  and  the  conceptualizations  of 
schooling  that  become  part  of  the  language  structure.  This  is  a  highly 
discursive  form  of  ^communication,  a  language  of  classification,  but  not  a 
language  to  use  vrtien  particular  "qualities  of  life"  must  be  revealed  (Eisner, 
1985a,  p.226). 

Within  Eisner's  alternative  paradigm,  the  mode  of  discourse  is 
non-discursive ,  it  is  metaphorical .  The  critic  must  draw  upon  his/her 
knowledge/conceptual/experiential  base  and  describe,  interpiS»t  and  evaluate  what 
they  experience.  This  is  a  language  form  that  "presents  to  our  consciousness 
what  the  feeling  of  those  o;aalities  is."  This  is  the  language  of  literature  and 
poetry. 


What  enables  us  to  participate  empathetically  in 
the  events,  lives,  and  situations  that  the  writer 
portrays  is  not  mere  factual  description. . . .  What 
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gives  litemture  its  power  is  the  way  in  which 
language  has  been  formed  ty  the  writer.  It  is  the 
"shape"  of  language  as  well  as  the  perceptive 
reooasnition  of  the  roataphorical^  connotative,  an? 
symbolic  character  of  particular  words  and  phrases 
that  makes  written  language  literature  (Eisner, 
1985a,  p.226). 

The  skills  of  the  critic,  as  both  coraraunicator  and  connoisseur,  are  evident 
here.  This  is  where  the  art  and  craft  of  the  critic  comes  into  play, 
translating  knowledge  from  one  form  to  another  form.  The  form  of  conraunication 
used  by  the  critic  becomes  the  public  expression  through  which  the  "life  of 
feeling"  and  qualities  of  experience  are  made  evident  and  shared.  "The  arts  are 
not  a  second-class  substitute  for  expression,  they  are  one  of  the  major  means 
people  throughout  history  have  used  both  to  conceptualize  and  express  what  has 
been  inexpressible  in  discursive  terms"  (Eisner,  1985a,  p.226) 

There  are  three  aspects,  or  dimensions,  to  educational  criticism: 
descriptive,  interpretive,  and  evaluative.  The  distinctions  between  the  three 
are  more  analytical  than  factual,  i.e.  they  each  have  a  different  focus  and 
emphasis. 

In  the  descriptive  aspect  of  educational  criticism,  the  critic  atteirpts  to 
"identify  and  characterize,  portray,  or  render  in  language  the  relevant 
qualities  of  educational  life."  Eisner  sees  this  aspect  as  making  the  greatest 
artistic  demands  on  the  critic,  i.e.,  it  is  this  aspect  of  criticism  where  the 
critic's  "verbal  magic  must  be  most  acute"  (Eisner,  1985a,  pp.230-231). 

In  the  intrepretive  aspect  of  educational  criticism,  the  critic  asks  and 
answers  the  questions:  "What  does  the  situation  mean  to  those  involved?  How 
does  this  classroom  operate?  What  ideas,  concepto,  or  theories  can  be  used  to 
explain  its  major  features?"  (Eisner,  1985a,  p.233).  This  is  where  the  critics 
"cohnoisseurship"  is  drawn  upon  to  use  the  multiple  theories,  viewpoints, 
frameworks,  models,  conceptualizations,  etc.,  to  interpret  the  meaning  of  events 
in  educational  settings.  The  important  point  is,  the  critic  draws  upon  his/her 
knowledge  and  intreprets  classroom  reality  using  differing  theoretical  models. 

In  the  evaluative  aspect  of  educatioral  criticism,  the  critic  makes  an 
assessment  of  the  educational  importance  s.l^ficance  of  the  experience 
he/she  has  described  and/or  interpreted.  Some  educational  criteria  must  be 
applied  in  order  for  the  critic  to  make  a  ^Judgment  about  the  experience.  This 
brings  out  the  nonnative  aspect  of,  and  the  value-ladenness  of,  educational 
experiences.  For  example,  the  function  of  educational  criticism  is  to  "imprdve 
the  educational  process."  This  can't  be  done  "unless  one  has  a  conception  of 
what  counts  in  that  pi^ocess"  (Eisner,  1985a,  pp.235-238).  The  conception  of 
"what  counts"  in  that  process,  what  constitutes  a  quality  educational 
experience,  is  dependent  upon  the  critic's  knowledge-base  (connoisseurship). 
History  and  philosophy  of  education  are  most  Important  ar^  of  study  for  the 
educational  critic  to  make  Judgnents  regeirding  the  value  of  educational 
experiences.  History  of  education  provides  "the  context  necessary  for  purposes 
of  comparisons",  and  philosophy  of  education  provides  "the  theores  from  which 
grounded  value  Judguents  can  be  made."  Hence,  a  broad  undrstandlng  of  the 
divergent    theoretical    aspects    of  education  "makes  it  possible  for  the 
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educational  critic  to  appreciate  v*iat  he  or  she  rejects  as  well  as  what  he  or 
she  accepts  within  educational  practice"  (Eisner,  I9e5a,  p.238). 

The  educational  connoisseur/educational  critic  mderstands  the 
value-ladenness  of  his/her  Judgjnenta.  As  is  the  case  with  airy  criticism, 
disagreement  with  ary  aspect  (descriptive,  interpretive,  evaluative)  of  the 
criticiarn  is  open  to  debate.  Eisner  sees  this  as  a  strength  of  qualitative 
inquiry: 

For  mxh  too  long,  educational  events  have 
been  assessed  as  though  there  were  only  one  set  of 
values  to  be  assigned  to  such  events....  Virtually 
every  set  of  educational  events,  virtually  every 
educational  policy,  virtually  every  roode  of  school 
organization  or  form  of  teaching  has  certain 
virtues  and  certain  liabilities.  The  more  that 
educational  criticism  can  raise  the  level  of 
discussion  on  these  matters,  the  better.  (Eisner, 
1985a,  p.237) 

Thus  multiple  perspectives,  diverse  theoretical  positivons  expand  the  dialogue  of 
educators  to  alternative  possibiltics,  which  could  help  'js  better  understand  the 
complexities  of  the  educational  process.  The  notions  of  educational 
connoisseurship  and  criticism  could  help  us  "appreciate"  the  conplexlty  and 
provide  a  broader  base  for  making  educational  Judgments  (Eisner,  1985a,  p.237). 


Concluding  Comment 

Eisner's  perspective  on  qualitative  inquiry  directly  addresses  the 
limitations  of  the  technical-rational  model  discussed  in  the  first  part  of  this 
paper*  Connolssairshlp/crlticism  allows  for  a  diversity  of  methods  in 
episteroology.  It  allows  for  diversity  of  teaching  methodology,  it  allows  for 
alternative  evaluation  methods  other  than  standardized  testing,  it  allows  for 
participation  of  students  in  the  over-all  educatioral  process,  it  conceptualizes 
the  whole  picture  of  education  as  opposed  to  parts,  and  it  provides  a  language 
system  that  can  deal  with  ambiguity  and  complexity.  In  effect,  Eisner  has 
provided  a  language  that  can  help  educators  "see"  education  differently,  or  he"*  a 
them  to  understand  why  they  "see"  education  differently. 

The  conceptualizations  of  educational  connoisseurship  and  criticism  and  its 
attended  diverse  language  system  provide  educators  wi.th  a  language  of 
possibility  that  unfreezes  educational  realities.  At  the  same  time,  thie  method 
of  qualitative  inquiry  provides  us  with  a  method  for  uncovering  the  meanings  of 
our  language  that  mig^it  be  blurred  by  custom  and  usage,  and  a  method  for 
examining  the  conceptual-base  of  our  views  on  school  practice. 

Because  of  the  moral  nature  of  schooling,  what  we  do  in  education  is  worth 
"another  look".  Knowledge,  percpetion,  language,  beliefs,  practice:  there  is 
no  separation. 
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Endnotes 


The  reductionist  viev^  I  am  referring  to  is  related  primstrily 
to  the  limited  language  system  used  to  talk  about,  and  hence 
work  within,  a  teaching/ learning  situation.   The  language 
systefn/world  view  is  tedinical,  efficient,  "given",  and 
unproblematic.   See  Dobson,  Dobson,  and  Koetting  (1985). 

The  following  assumptions  undergird  my  positioi  in  this 
paper: 

a.  THye  viay  educators  talk  affects  vrtiat  tiiey  see 
(perceptions).   This  p*ienomenon  also  works  in  a 
reciprocal  fashion.   Causal  priority  does  not  seem 
particularly  important. 

b.  Perceptions  and  language  are  reflective  of  the 
philosophic  posture  (value  system)  of  the  person 
observing  anu  talking. 

c.  The  interplay  of  these  three  variables  (perception, 
language,  and  value  i^ystem)  influences  the  nature 

of  the  teaching-learning  experiences  (Communication) . 

d.  The  language  of  a  profession  can  a  priori  determine 
perceptions  and  consequently  human  experience. 

(Dobson,  Dobsoi,  &  Koetting,  1985) 

Habermas'  "theoiy  of  knowledge"  has  three  forms,  or  processes, 
of  inquiry.   Kiowledge  can  be  arrived  at  througji  (1)  the 
empirical-analytic  sciences,  (2)  thie  historical-hermeneutic 
sciences,  and  (3)  the  critically  orxer \^  sciences  (critical 
theory) .   These  forms  or  viewpoints  of  knowledge  results  in 
three  categories  of  possible  knowledge: 

Information  that  expands  our  power  of  tedinical  control; 
interpretations  that  make  possible  the  orientation  of 
action  within  common  traditions;  and  analyses  that  free 
consciousness.  fixxn  its  dependence  on  hypostatized  powers. 
These  viewpoints  originate  in  the  interest  structure  of 
a  species  that  is  linked  in  its  roots  to  definite  means 
of  social  organization:  work,  language  and  power 
(Habermas,  1971,  p. 313). 

These  categories  of  possible  knowledge  thus  establish  the 
"scientific  viewpoints"  fi*om  which  we  can  know  reality  in  any 
way  whatsoever:    "orientation  toward  teduiical  control, 
toward  mutual  understanding  in  the  ccxiJuct  of  life,  and 
toward  emancipation  from  seemingly  •natural*  constraints 
(Habermas,  1971,  p.311).    These  modes  of  inquiry  with 
constitutive  interests  delineate  the  way  in  which  individuals 
generate  knowledge \ 
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How  Past  Research  on  Learner  Control 
Can  Aid  in  the  Design  of  Interactive  Video  Materials 


William  D*  Milheim  and  Janet        Azbell  (1) 


Introduction 

Interactive  video  is  the  combination  of  a  computer 
and  a  video  source  in  a  single  instructional  medium 
that  provides  the  best  characteristics  of  each.  The 
computer  provides  intelligent  branching  and  easily- 
changeable  text 9  while  the  video  source  (tape  or  disc) 
provides  true-life  visuals  with  accompanying  audio. 

The  following  suggestions  for  the  design  of 
interactive  video  materials  are  synthesized  from 
learner  control  studies  in  a  number  of  areas.  While 
these  suggestions  focus  mainly  on  the  use  of  learner 
control  with  interactive  video ,  they  also  are  generally 
applicable  to  instructional  materials  presented  through 
computers  without  supplemental  video. 

Definition  of  Learner  Control 

Learner  control  can  be  described  as  the  degree  lo 
which  a  learner  can  direct  his  or  her  own  learning 
process.     In  theory,  such  control  could  include  student 
choices  at  the  curriculum  level,  the  opportunity  for  a 
student  to  study  a  given  unit  or  lesson  as  long  as 
needed,  or  the  ability  of  the  student  to  select  and 
sequence  a  variety  of  internal  processing  strategies 
(Merrill,  1980).     However,  this  term  most  often 
describes  the  instructional  choices  made  during  a 
particular  lesson.    By  definition,  these  choices  can  be 
made  either  by  the  instructional  program  (as  originally 
defined  by  a  designer)  or  by  the  learner  during  the 
presentation  of  the  materials. 

The  use  of  learner  and/or  program  control  can  also 
be  described  as  the  locus  of  instructional  control, 
%^ith  the  control  of  instruction  being  either  external 
(program  control)  or  internal  (learner  control). 
Hannafin  (1984)  used  this  terminology,  describing 
external  instructional  control  as  shown  in  those 
situations  where  all  learners  follow  a  predetermined 
path  established  by  the  designer.     Internal  locus  of 
instructional  control  is  shown  in  lessons  where 


(1)  This  paper  is  based  on  the  dissertation  research  of 
both  authors.     Detailed  results  of  this  research 
will  be  presented  orally  at  the  conference. 
Readers  are  encouraged  to  also  read  Hannafin  (1984) 
for  a  similar  list  of  suggestions. 
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individuals  control  the  path,  pace,  and/or 
contingencies  of  instruction^     Steinberg  (1977)  adds 
sequencing,  instructional  strategy,  completion  time, 
amount  of  practice,  and  level  of  difficulty  to  the 
variables  that  may  be  controlled  either  by  the  student 
or  by  the  computer • 

The  specific  variables  under  study  in  learner 
control  research,  therefore,  typically  include  content, 
sequence,  and  pacing*    Each  of  these  may  be  included  to 
some  extent  in  each  learner  control  study.     Control  of 
content  is  often  studied  by  allowing  some  students  to 
choose  the  amount  of  material  they  wish  to  learn,  while 
control  of  sequence  is  usually  researched  by  permitting 
some  students  to  choose  the  order  of  their  learning* 
Pacing t  often  neglected  in  some  learner  control 
studies,  is  now  being  investigated  in  some  inistances 
(e*g*,  Belland,  Taylor,  Canelos,  Dwyer,  &  Baker,  1985) 
where  pacing  is  controlled  either  by  the  learner  oi^  by 
the  program* 

Early  Research  with  Learner  Control 

One  of  the  earliest  discussions  concerning  the 
ability  of  some  students  to  control  their  own  learning 
indicated  that  some  adult  learners  tend  to  be  able  to 
direct  their  own  learning  when  given  control  of  their 
curriculum  (Mager  ft  Clark,  1963)-     A  similar  study 
(Fernald,  Chiseri;  &  Lawson,  1975)  showed  that  student 
pacing  enhanced  students'  achievement  and  to  some 
degree  increased  students'  positive  evaluations  of  a 
course* 

Other  early  research  in  learner  control  (Judd, 
1972;  Judd,  Bunderson,      Bessent,  1970;  Lahey,  Hurlock, 
&  McCann,  1973)  began  to  examine  this  instructional 
variable  in  greater  detail*     Generally,  this  group  of 
studies  showed  that: 


1*  Learner  control  should  perhaps  only  be  used 
when  the  studf nts  already  have  some  exper- 
tise in  a  content  area* 

2*  Learners  have  mixed  feelings  over  being 
given  control  over  their  learning  (i*e*, 
sometimes  they  prefer  it,  sometimes  they  do 
not)  * 

3*  Learners  need  training  in  the  use  of  learner 
control  to  be  able  to  use  it  effectively* 


Merrill  (1979)  also  reported  studies  on  the  use  of 
learner  control  in  computer  based  learning  situations* 
While  nono  of  the  data  shoved  that  the  use  of  learner 
choice  caused  a  drop  in  student  learning,  there  was 
also  no  clear  indication  that  the  overall  use  of 
learner  control  consistently  increased  achievement, 
efficiency,  or  attitude  toward  the  instruction* 

Merrill  (1979,   1980)  also  discussed  the  importance 
of  students  controlling  their  own  cognitive  processing 
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of  the  information  presented  to  them.     In  addition, 
Merrill  stated  that  the  challenge  is  not  whether  to  use 
learner  control  at  all,  but  how  to  help  each  student 
best  use  the  learner  control  that  is  available. 

Based  on  the  above  studies,  some  type  of  learner 
control  (e.g.,  pacing  or  sequence)  would  appear  to  be 
appropriate  for  instructional  materials  presented 
through  interactive  video*     This  use  may  be  particu- 
larly appropriate  with  interactive  video  as  the 
instructional  medium,  since  instructional  control  is 
needed  both  for  computer  text  and  video/audio  material. 

Training  in  how  to  use  the  available  learner 
control  options  is  c.lso  very  important,  especially  with 
interactive  video  where  the  learning  materials  may  be 
less  structured  and  the  system  more  complicated  to  use. 
Such  training  is  particularly  important  with  this  new 
medium  since  the  learner  may  be  totally  unfamiliar  with 
this  type  of  learning  system. 

Studies  Supporting  Learner  Control 

Supporting  the  idea  that  students  would  benefit 
from  having  a  great  deal  of  control  over  their  own 
learning^  Campanizzi  (1978)  showed  achievement  gains  to 
be  significantly  greater  under  learner  control  than 
program  control.     In  a  similai  manner,  Newkirk  (1973) 
showed  that  long-term  retention  (two  weeks)  was  signi- 
ficantly greater  and  attitudes  were  slightly  more 
favorable  for  those  who  were  allowed  to  use  learner 
control . 

There  also  appears  to  be  a  strong,  intuitive 
appeal  for  allowing  students  to  choose  the  type  of 
instruction  they  will  receive  (Carrier,  1984).  In 
support  of  th?s  intuitive  appeal,  Santogrossi  and 
Roberts  (1978,  described  how  students  without  an 
externally  iiaposed  structure  may  be  able  to  allocate 
more  energy  for  new  or  difficult  material  and  spend 
less  time  and  effort  on  familiar  content.     They  klso 
stated  that  an  instructor-selected  pace,  no  matter  what 
it  may  be,  would  be  inappropriate  or  boring  for  a  large 
proportion  of  the  class. 

Allowing  students  to  skip  over  material  they 
already  know  is  also  intuitively  appealing  in  inter- 
active video  instruction,  where  materials  are  often 
designed  to  be  learned  in  a  less  structured  manrier. 
While  giving  students  this  type  of  control  may  appear 
to  be  beneficial,  it  may  in  the  long  run  reduce 
effectiveness  by  allowing  other  students,  not  familiar 
with  the  content,  to  also  omit  certain  parts  of  the 
instruction. 

Studies  with  Mixed  Support  for  Learner  Control 

While  the  above  research  generally  supports  the 
use  of  learner  control,  another  body  of  research  (e.go, 
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Balson,  Manning,  Ebner,  &  Brooks,   1984/85;  Mayer,  1976; 
Reiser  k  Sullivan,  1977)  has  shown  that  such  control  is 
associated  only  with  equivalent  learning  gains,  rather 
than  increased  achievement*    The  results  from  this 
group  of  studies  showed  that: 

1*  Learner  control  is  as  effective  (but  not 
more  effective)  in  terms  of  achievement 
scores  for  students  using  this  control 
strategy. 

2«  Attitudinally,  learner  control  is  rated 

equal  to  (or  better  than)  program  control  by 
students  using  these  strategies^ 

In  addition,  students  using  learner  control  often 
chose  to  end  an  instructional  sequence  too  soon  when 
they  were  given  control  over  the  amount  of  information 
they  were  to  see  (control  of  content).     One  such  study 
(Fisher,  Blackwell,  Garcia,  &  Greene,  1975)  showed 
learner  control  to  be  associated  with  students  working 
substantially  fewer  problems  per  day  (although  this 
group  was  rated  higher  in  engagement  by  observers) • 

Fry  (1972)  also  showed  that  subjects  under  a  high 
degree  of  learner  control  learned  the  least,  although 
they  did  form  the  most  favorable  attitudes  toward  the 
method  of  instruction.     Gay  (1986)  showed  similar 
results  with  the  learner  control  groups  overall  showing 
lower  or  equal  achievement  scores  than  groups  under 
program  control. 

These  results  somewhat  reduce  the  justification 
for  including  some  type  of  learner  control  in  an 
instructional  lesson.     Based  on  this  research i 
designers  should  limit  to  some  degree  the  learner 
control  available  for  students  learning  from  inter- 
active viueo  materials.     Such  control  should  include 
only  very  limited  control  of  content  (choosing  whether 
or  not  to  study  a  particular  lesson)  and  perhaps  only 
partial  control  of  the  sequence  and/or  pacing. 

Available  learner  control  might  specifically 
include  the  ability  to  choose  the  sequence  of  topics, 
the  option  to  choose  computer  text  or  video  materials, 
and  the  ability  to  control  the  overall  pace  of  the 
presentation  of  the  instruction.     As  described  above, 
care  should  be  taken  when  learners  are  allowed  to 
choose  whether  or  not  to  actually  view  certain 
materials  (computer  text  or  video  sequences)  since 
learner  control  of  content  may  allow  some  students  to 
omit  important  lesson  modules. 

Adaptive  Control  Strategies 

One  alternative  co  standard  learner  control  has 
been  the  use  of  adaptive  control  strategies.    Using  a 
computer-based  algorithm,  this  type  of  strategy  adjusts 
the  learning  environment  and  prescribes  instructional 
treatments  within  an  individual  lesson  to  meet  indivi- 
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dual  student  needs  and  characteristics  (Tennyson  & 
Rotheni  1979). 

Although  extremely  complex  to  design »  such  systems 
have  been  used  quite  effectively  in  providing  an  alter- 
native to  strictly  learner  controlled  or  program  con- 
trolled instruction.    The  results  of  studies  in  this 
area  ( Tennyson ,  Parki  &  Christensen,  1985;  Ro&s  & 
Rakowi  1981;  Tennyson >  Tennyson,  &  Rothen,  1980)  have 
shown  that: 

1*  Groups  using  adaptive  control  perform  better 
than  either  program  control  or  learner 
control  groups  on  both  immediate  and  delayed 
tests  of  achievement • 

2.  Groups  using  standard  learner  control  gener- 
ally finished  in  less  time  and  performed 
less  well  in  final  achievement  tests  than 
those  using  adaptive  control* 

3.  Groups  using  standard  learner  control  showed 
an  increasing  deficit  from  the  immediate 
test  to  the  delayed  test  as  compared  to 
adaptive  learner  control  (Ross  &  Pakow, 
1981). 

While  much  of  the  adaptive  control  research  has 
been  carried  out  with  complex ,  instructional  systems » 
interactive  video  designers  can  still  learn  some  stra- 
tegies from  its  implementation.     The  most  important  of 
these  is  obviously  the  importance  of  adapting  the 
instruction  to  the  needs  of  the  individual  learner 
currently  using  the  system.    While  the  adaptation  used 
in  most  interactive  video  systems  cannot  be  nearly  as 
comprehensive  as  that  used  in  the  research  described 
above 9  it  jan  still  include  appropriate  pretests, 
embedded  questions,  and  other  attempts  at  understanding 
the  needs  of  the  ^earner. 

Such  adaptation  is  particularly  important  with 
interactive  video  where  the  complv^xity  of  the  system 
may  overwhelm  some  learners.     Decisions  concerning  the 
appropriate  use  of  computer  text,  branching,  and  video 
playback  at  appropriate  times  in  a  lesson  are  extremely 
important,  especially  when  numerous  options  are  avail- 
able in  the  learning  system. 

Learner  Control  with  Advisement 

Another  type  of  learner  control  research  can  be 
described  as  learner  control  with  advisement,  a  situ- 
ation where  the  learner  is  able  to  make  some  decisions 
as  to  content,  sequence,  etc.,  wnile  the  program  makes 
suggestions  for  some  of  those  choices.     Such  advisement 
may  be  necessary  since  typical  learner  control  strate- 
gies may  fail  to  provide  students  with  the  necessary 
cognitive  information  about  their  learning  progress  by 
which  they  can  make  mear'^  ^ful  decisions  (Tennyson  & 
Rothen,  1979). 
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Subjects  using  this  advisement  control  strategy 
have  been  compared  to  groups  having  complete  control  or 
adaptive  control  of  an  instructional  program  in  a 
number  of  different  studies  (Hannafini  Qarharti  Rieberi 
a  Phillips,  1985;  Tennyson,  1980;  Tennyson,  ISfjl; 
Johansen  &  Tennyson,  1983)*    The  results  of  these 
studies  showed  that  groups  receiving  advisement 
information  in  general: 

1*  had  higher  post-test  means, 
2*  had  more  students  reach  mastery, 
3*  had  longer  time  on  task, 
4*  needed  less  instructional  time,  and 
S*  needed  fewer  instructional  instances* 
In  a  similar  study,  Laurillard  (1984)  found  that 
students  do  make  use  of  instructional  suggestions  and 
like  being  given  advice  on  what  to  do  next  in  terms  of 
sequence  and  strategy*     Qoetzfried  and  Hannafin  (1985) 
also  found  that  learning  using  a  learner  controlled 
advisement  strategy  was  effective,  reporting  comparable 
learning  results  among  ar  adaptive  strategy,  an 
advisement  strategy,  and  a  typical  linear,  program 
control  strategy,  although  linear  control  was  more 
efficient  in  terms  of  time* 

The  above  results  may  also  be  applied  to  the 
design  of  effective  interactive  video  instruction* 
Unlike  the  difficulty  of  applying  adaptive  control 
strategies,  advisement  can  be  easily  applied  to 
interactive  video*     Such  advisement  could  include  any 
or  all  of  the  following: 

1*  Suggestions  for  choosing  a  particular 

instructional  sequence* 
2*  Suggestions  for  viewing  a  videotape/ 

videodisc  passage  for  more  information* 
3*  Giving  extra  information  concerning  why  a 
particular  choice  should  be  made* 

Effects  of  Learner  Characteristics 

The  use  of  learner  control  has  also  been  shown  to 
be  affected  by  certain  student  characteristics*  For 
example,  while  Fry  (1972)  showed  that  learner  control 
overall  was  a  detriment  to  learning,  its  use  actually 
increased  learning  when  the  students  were  ^'f  high 
aptitude  and  high  inquiry*     In  a  similar  manner.  Gay 
(1986)  demonstrated  that  students  using  learner  control 
were  much  more  efficient  in  the  use  of  their  time  when 
they  had  a  prior  conceptual  understanding  of  the 
material  * 

Ross  And  Hakow  (1981)  also  supported  this  '^ype  of 
interactive  effect,  showing  that  high  entrance  ability 
students  performed  equally  well  under  both  program  and 
learner  control  conditions*     In  a  similar  way,  Allen 
and  Merrill  (1985)  discussed  the  differential  effec- 
tiveness of  learner  control  in  their  description  of  an 
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"expert  learner/*  described  as  someone  who  can  select 
and  apply  appropriate  learning  strategies  without  help. 
Studies  such  as  these  suggest  that  while  learner 
control  overall  nay  not  be  an  effective  or  efficient 
learning  strategy  for  all  students  i  it  mc^y  be  worth- 
while for  those  learners  with  higher  aptitude  or 
previous  knowledge  of  the  instructional  content. 

This  research  suggests  that  learner  control  with 
interactive  video  can  be  used  most  effectively  with 
higher  ability  students  or  with  students  who  already 
have  sone  knowledge  in  the  content  area  to  be  taught. 
If  instruction  is  being  designed  for  learners  other 
than  these  groups i  there  should  be  limits  placed  on  the 
amount  of  available  learner  control. 

Research  with  Learner  Control  aiid  Interactive  Video 
Specific  studies  looking  at  the  use  of  learner 
control  with  interactive  video  have  been  very  small  in 
number.    While  this  lack  of  studies  is  probably  due  to 
the  lack  of  overall  research  studies  with  this  new 
medium!  there  have  been  several  studies  of  importance 
in  this  area. 

One  of  the  first  studies  learner  control  and 
interactive  video  (Laurillardi  1984)  reported  a  small 
field  trial  of  this  new  technology  at  the  Open  Univer- 
sity in  England.    Using  interactive  videotape i  this 
study  showed  that: 

1.  Students  make  sequencing  choices  that  are 
often  different  from  the  expected  sequence. 

2.  Students  like  advice  on  what  sequence  or 
strategy  to  use  at  a  certain  point. 

3.  Students  do  make  use  of  this  advice  when 
offered. 

Laurillard  also  stated  that  student  control  of  sequence 
in  free  learning  situations  is  important  since  a  stu- 
dent ^s  choice  of  route  is  likely  to  be  more  meaningful 
than  the  alternate  routes  not  chosen  by  the  student 
during  the  program. 

Hannafirii  et.  al.  (1985)  also  discussed  the  use  of 
learner  control  in  interactive  video  instruction. 
While  stating  that  it  iir  not  advisable  i  in  general  i  to 
allow  learner  control  unless  additional  prompting  is 
provided I  these  authors  also  stated  that  there  is 
evidence  to  suggest  that  an  imposed  lesson  structure 
has  the  potential  for  conflict  with  a  learner ^s 
internal  schema. 

Finally I  Gay  (11J6)  reported  research  which  showed 
an  interactive  effect  between  prior  familiarity  with  a 
topic  and  the  use  of  learner  control  in  an  interactive 
video  learning  situation.    While  overall  postteat 
scores  were  higher  with  subjects  under  program  control i 
equivalent  scores  were  reported  between  program  and 
learner  control  for  those  students  with  a  high  prior 
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conceptual  understanding       the  material*    As  described 
above t  Gay  also  demonstrated  that  students  with  a  prior 
conceptual  understanding  of  the  material  were  much  more 
efficient  in  the  use  of  their  time  when  using  learner 
control.    According  to  the  author »  it  appeared  that 
prior  conceptual  understanding  may  have  acted  as  an 
advance  organizer i  making  the  presentation  of  well- 
structured  materials  (program  control}  considerably 
less  important. 

Findings  from  this  research  are  similar  to  the 
results  already  described  in  the  preceding  sections. 
These  findings  include  the  importance  of  providing 
students  with  advice  concerning  learner  control 
options  9  the  possible  negative  effects  from  an  imposed 
lesson  structure,  and  the  importance  of  previous 
knowledge  when  using  learner  control • 

Conclusion 

While  most  of  the  above  research  concerns  the  use 
of  computers  to  present  5nstructional  materials »  much 
can  also  be  gained  from  tiiis  research  concerning  the 
effective  design  of  interactive  video  materials.  Sug- 
gestions for  this  design  are  summarized  below: 

1.  Some  type  of  learner  control  may  be 
appropriate  in  man;  different  interactive 
video  learning  situations.  " 

2.  Training  in  how  to  use  learner  control 
options  is  extremely  important. 

3 4  Learner  control  of  content  is  often  not 
appropriate  since  some  students  may  skip 
important  material  or  quit  the  lesson  too 
soon. 

4.  The  adaptation  of  interactive  video  mater- 
ials for  each  learner »  although  potentially 
difficult  I  is  very  important. 

5.  Advising  a  student  during  instruction  as  to 
sequence »  etc.  should  help  increase  reten- 
tion. 

6.  Learner  control  may  be  most  effective  with 
higher  ability  learners  or  those  with  some 
prior  knowledge  of  the  content. 

While  the  above  suggestions  certainly  do  not 
guarantee  the  effective  design  of  interactive  video 
materials  that  incorporate  some  type  of  learner 
control  9  they  should  aid  the  instructional  designer  in 
the  incorporation  of  various  learner  control  options. 
The  appropriate  use  of  these  suggestions  should  also 
increase  the  effectiveness  of  the  materials  that  make 
use  of  these  options. 
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The  inclusion  of  subliminal  messages  within  the  educatiOiial  films  or  videotape  micht 
be  a  useful  but  controversial  technique.  Subliminal  perception  is  defined  as  a  visual  stimulus 
which  occurs  below  the  level  of  conscious  awareness  and  could  effect  an  individual's  behavior. 
Moore  (1982)  suggested  that  possible  uses  of  subliminal  messages  in  instruction  might  include: 
directmg  student  attention,  reiterating  certain  concepts,  promoting  affective  goals  or 
supplanting  perceptions  of  visual  elements  or  actually  teaching  unrelated  concepts.  Amid  the 
controversy  m  the  late  fifties  over  subliminal  perception  used  in  advertising,  numerous  research 
studies  have  failed  to  indicate  consistent  results. 

 .  •#_   f  •«  '  •    •  used  te  6VIS1011  or  ^Im^  2t  was  attempted  to  teach  one  idea 

or  task  while  viewing  an  unrelated  program.  These  approaches  did  not  prove  successful,  as 
students  did  not  perform  better  from  subliminal  instruction  unrelated  to  the  content  in  the 
program  (DeChenne,  1976;  and  Taris,  1970).  Moore  and  Moore  (1984)  however,  found  a 
significant  difference  in  recall  between  field  independents  and  field  dependents  when  viewing 
subluninal  television  captions  which  supplemented  visible  captions  and  thus,  may  be  an 
effective  device  for  improving  achievement  attributable  to  cognitive  style.  This  potential  of 
subhminal  activity  to  improve  instruction  as  shown  in  the  Moore  and  Moore  (1984)  study 
suggests  a  possible  interaction  between  cognitive  style  and  subliminal  information.  This  result 
gave  nse  to  the  possibility  of  the  current  study  -  testing  if  cogntive  style  (individual  differences 
of  field  dependence-independence)  would  interact  with  a  subliminal  task  taught  virithin  a  film 
(videotape)  of  unrelated  context.  To  test  this  possibUity  a  partial  replication  of  the  earUer  study 
by  DeChenne  (1975)  was  conducted. 

Ausbum  and  Ausbum  (1978)  urged  continued  study  into  the  relationship  between 
properties  of  media  and  the  characteristics  of  individual  learners.  Witkin  and  his  associates 
have  conducted  most  of  the  research  and  have  provided  much  of  the  information  concerning 
V*e  cognitive  style  of  field  dependence  and  field  independence.  Much  of  their  work  is 
frnmanzed  in  the  Review  of  Educational  Research.  Witkin.  et  al.  (1977)  People  classified  as 
field  independent  tend  to  be  able  to  give  structure  to  unstkctured  material  and  can  separate 
parts  from  its  whole.  Field  dependents  need  structure  and  tend  to  view  objects  and  scenes  in 
their  entirety.  Compared  to  field  independents,  field  dependents  have  a  greater  need  for  and 
are  more  dependent  on  external  sources  of  structure  and  organization.  Information  recall  from 
visuals  for  field  dependents  is  facilitated  if  major  cues  are  irrelevant  or  not  noticeable.  Field 
independents  tend  to  be  able  to  take  information  from  both  irrelevant  and  relevant  cues.  Field 
dependents  tend  not  to  add  structure  to  visuals  and  accept  visuals  as  presented  (Witldn  et  al.. 

Differences  in  learning  may  result  from  an  interaction  between  cognitive  style  (field 
dependent,  field  independent)  and  the  teaching  subliminally  a  task  unrelated  film  or  tape  being 
shown.  It  appears  that  the  ability  to  perceive  subliminal  messages  varies  and  cognitive  style 
could  be  a  factor:  Moore  (1982)  states: 

How  people  perceive  a  televised  image  that  contains  a  subliminal  message 
may  be  partially  determined  or  influenced  by  the  process  they  use  to 
analyze  and  decode  the  visual  field...  and  as  such  may  be  related  to 
cognitive  style  (p.  27). 

Because  field  independents  are  more  capable  of  consciously  discerning  parts  of  a  visual  scene 
and  field  dependents  have  more  difficulty  with  a  similar  task  it  is  hypothesized  that  field 
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independents  v/ould  be  able  to  discern  subliminal  messages  better  than  field  deoendents. 
Although,  subliminal  messages  are  not  consciously  perceived.  The  repeated  nature  of  the 
presentation  (14  tunes)  and  th5  formal  structure  of  organizing  the  information  (i.e.,  the  seven 
parts  of  the  puzzle  presen*-.d  in  the  same  order)  might  increase  the  importance  of  context  cues 
and  make  them  more  relevant  for  the  field  dependent  per^^pn.  Thus  field  dependents  who  were 
shown  the  subliminal  treatment  might  in  fact  do  better  in  completing  the  task  than  those  field 
dependents  who  were  not  given  the  subliminal  message.  The  purpose  of  this  study  was  then 
to  test  these  hypotheses  of  students'  ability  to  learn  a  subliminal  task  while  viewing  a 
non-related  fihn. 

DeChenne  (1976)  attempted  to  teach  problem-solving  psychomotor  skill  by  subliminally 
showing  the  pieces  of  a  puzzle  being  assembled.  On  a  videotape,  the  seven  consecutive  steps 
for  assembling  the  puzzle  were  repeatedly  superimposed  on  a  university  public  relations  film. 
Elementary,  high  school  and  college  age  students  comprised  the  sample  groups.  Following  the 
tape,  the  participants  took  a  timed  test  to.assemble  the  puzzle.  Only  a  few  participants  m  any 
group  w<?re  able  to  assemble  the  puzzle  correctly,  but  there  was  a  tendency  fcr  the  sublimmal 
treatment  groups  to  assemble  correctly  the  puzzle  more  frequently  than  the  associated  control 
groups.  This  tendency  was  not  statistically  reUable.  However,  no  measures  of  mdividual 
differences  were  tak;en  mto  account.  In  this  study  using  an  olde^  atidience  of  all  college 
students,  the  above/study  was  partially  replicated  using  cognitive  style  (field  independence, 
field  depenaence)  as  the  mdependent  variable  to  test  the  hypothesis  of  the  interaction  of 
cognitive  style  and  subliminal  instruction. 

Subjects 


The  subjects  for  this  experiment  were  132  undergraduate  college  students  (92  female,  40 
male)  enrolled  in  professional  education  courses.  These  subjects  v;ere  classified  as  field 
dependent,  neutral  or  as  field  independent  by  means  of  the  Group  Embedded  Figures  Test 
(GEFT)  (Consulting  Psychologists  Press,  1977).  Because  the  t3st  manual  sets^no  guidelines  foi 
groupmg,  the  subjects  were  arbitrarily  assigned  into  the  abPve  categories  in  approximately 
thirds  based  upon  their  scores  (0-18).  Subjects  with  scores  of  15  and  higher  ,vere  classified  as 
field  independent  (N= 47),  those  subjects  with  scores  ranging,  from  11-14  as  neutrals  (N=45) 
and  those  with  scores  of  10  and  under  were  classified  as  field' dependent  (N=40). 

Procedures 

The  task  chosen  by  DeChenne  (1976)  to  be  taught  subliminally  was  the  assembly  in 
order  the  pieces  of  a  tangram.  A  tangram  consists  of  seven  geometric  figures  when  correctly 
assembled,  for  a  square.  The  seven  parts  of  the  cangram  are  illustrafsd  in  Figure  1. 

For  the  productibu  of  the  slides,  the  sevjn  geometric  parts  of  a  tangram  were  cut  out 
of  posterboard.  The  seven  geometric  figures  were  assembled^and  photocopied  on  a  copy  stand 
to  form  a  square.  As  each  figure  was  placed  on  the  copy  §tand,  a  slide  was  taken.  The 
completed  slide  series  consisted  of  the  seven  slides  also  illustrated  in  Figure  1. 

The  following  criteria  were  used. in  selecting  the  film  used  in  this  experiment. 
I.  The  film  was  approximately  15  minutes  in  length. 


476 

^'  474 


wsllS.3 


2.  The  content  of  the  film  did  not  contain  academic  subject  matter. 

3.  The  content  of  the  film  was  not  related  to  the  task  taught  subliminaDy. 

A  promotional  film  was  entitled  Tech  Territory"  produced  by  the  Informational 
Services  Film  Unit  at  Virginia  Tech  was  selected. 

Two  video  tapes  were  produced  for  use  in  this  study.  One  video  tape  contained 
subliminal  the  stimuli  and'  he  other  contained  no  subliminal  stimuli.  For  the  production  of  the 
video  tape  containing  subliminal  stimuli,  the  2  inch  by  2  inch  slides  showing  the  step-by-step 
procedures  involved  in  assembling  the  seven  geometric  figures  of  a  tangram  into  a  square  were 
presented  by  a  Schneider  Synchro-Compur  shutter  with  a  setting  of  1/200  of  a  second.  A  video 
tape  recorder  recorded  the  simultaneous  projection  of  thy  film  through  the  film  chain  and  the 
superimpostion  of  the  projected  slides. 

The  slides  were  presented  at  five  second  intervals  until  the  entire. slide  series  had  been 
presented.  The  entire  slide  series  was  presented  14  times  during  the  showing  of  the  video  tape. 

For  the  production  of  the  video  tape  containing,  no  subliminal  stimuli,  the  film  was 
projected  through  the  film  cham  and  recorded  by  a  video  tape  recorder.  The  subjects  viewed 
either  the  film  with  the  subliminal  stimuli  or  the  film  without  the  stimuli  by  random  selection. 
They  viewed  the  presentation  oii /the  same  25  inch  television  monitor  in  groups  of  eight  or  less. 
At  the  completion  of  the  video  tape,  ach  subject  was  given  an  envelope  containing  the  seven 
pieces  of  a  tangram  and  given  10  minutes  to  assemble  the  pieces  into  a  square.  Upon  time 
being  called  the  number  of  pieces  assembled  correctly  was  noted.  The  total  presentation  was 
approximately  25  minutes  including  instruction  and  time  to  assemble  the  tangram. 

The  dependent  variable  used  in  this  study  was  to  be  the  number  of  pieces,  zero  to  seven, 
assembled  correctly.  Only  pieces  assembled  in  the  manner  described  by  the  subliminal  slides 
were  to  be  counted.  The  independent  variable  was  field-dependence,  neutral  or  field 
independence. 

Results 

A  two  way  analysis  of  variance  was  the  statistical  design  used  in  this  study.  The 
summary  table  of  the  analysis  of  variance  based  upon  the  means  in  Table  1  is  presented  in 
Table  2.  The  F  ratio  dealing  with  field  dependency  (F(2,126)  =  .70,  p  =  .5007)  was  not 
?Sn^%^^^'  Neither  was  the  F  ratio  dealing  with  treatment  (subliminal  or  non-subliminal) 
(F(l,126)  =  .02,  p  =  .8822)  nor  was  the  F  ratio  dealing  with  interaction  between  dependency 
and  treatment  (F(2,126)  =  .74,  p  =  .4804).  As  shown  in  the  Table  of  Means,  the  mean  scores 
lor  all  groups  were  quite  small  considering  the  possible  0-7  as  the  criterion  score.  None  of  the 
main  effects  nor  the  interaction  between  cognitive  style  and  treatment  were  significant. 

Discussion 

In  ail  effort  lo  see  if  cognitive  style  and  the  attempt  to  teach  a  task  non-related  to  a 
videotaped  presentation,  it  is  clear  that  the  attempt  do  not  work.  The  results  were  similar  to 
what  DeChenne  (1976)  originally  reported,  subjects  in  this  study  were  not  able  to  be  taught  a 
task  subliminally  no  matter  what  cognitive  style.  These  findings  are  also  in  accordance  with 
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Taris  (1970)  who  was  unable  to  teach  a  science  concept  subliminally.  Skinner  (1969),  however, 
was  able  to  increase  vocabularies  of  ninth  graders  via  a  subliminal  approach.  DeChenne  (1976) 
in  his  original  study  suggested  that  the  size  of  screen,  the  resolution  of  the  color  video  tape  dhd 
the  placement  of  the  subliminal  stimuli  over  moving  objects  on  the  screen  may  have  limited  the 
subjects'  ability  to  perceive  the  stimuli.  Moore  , (1982)  in  reviewing  DcChenne's  experiment  also 
suggested  that  if  the  subliminal  treatment  had  stressed  the  final,  assembled  pattern  rather  than 
arbitrarily  defined  sequence  of  placement,  there  might  have  been  a  larger  number  of  correctly 
assembled  parts.*  This  author,  however,  feels  tha.  there  are  other  possibilities.  First,  the  task 
may  have  been  too  difficult  and  the  amount  of  subliminal  and  the  amount  of  subliminal 
stimulus  too  small.  In  setting  up  the  design  of  the  study  it  had  been  decided  to  use  a  subliminal 
tasks  unrelated  to  the  content  of  the  film  presentation.  The  subliminal  instruction  was  to  stand 
alone  and  not  reinforced  by  the,  film's  content  to  avoid  a  confounding  factor  of  sources  of 
information.  However,  because  of  this  fact  that  subjects  were  concentrating  on  the  content  of 
the  video  tape  itself  may  have  caused  the  communication  channels  to  become  overloaded 
and/or  confused.  This,  of  course,  had  assumed  that  a  subliminal  approach^  would  or  could 
teach  a  concept.  It  is  obvious  at  least  in  this  experiment  and  in  that  of  the  eariier  DeChenne 
experiment,  non-related  subliminal  instructional  task  within  a  film  (videotape)  was  not  taught 
no  matter  what  cognitive  style.  Although  in  this  experim-nt  the  means  were  higher  (not 
significantly)  for  the  subliminal  treatment  fox'  both  field  independents  and  field  dependents. 
This  wias  also  true  in  DeGhenne's  earlier  experiment.  The  mean  of  criterion  scores  0-7 
indicated  the  average  was  just  above  1.0,  which  indicates  that  an  individual  subjects  were  able 
to  get  only  a  small  part  of  the  puzzle  correct.  It  was  hypothesized  that  field  independent 
individuals  would  by  their  nature,  be  able  recognize  and  thus  disembed  consciously  or 
^consciously  the  subliminal  stimuli  and  to  use  that  information  to  assemble  the  puzzle  than 
field  dependents.  The  field  dependents  which:  had  the  subliminal  treatment  did  not  do 
significantly  better  than  those  not  receiving  the  subliminal  treatment  as  hypothesized. 
However,  there  may '  3  a  possibility  that  subjects  could  be  taught  this  skilibf  if  alerted  to  the 
fact  of  subliminal  presence  and  the  task  at  hand. 


*Note:  In  this  study  both  the  order  of  pieces  and  the  final  pattern  were  .  jviewed  with  no 
difference  m  the  final  result. 

Theviuthor  expresses.gratitude  to  Ms.  Janice  McBee  for  assistance  in  the  statistical  analysis. 


This  paper  is  based  upon  the  following  article:  Moore,  D.  M.  '">5).  Cognitive  Style  and  a 
Subliminally  Taught  Task.  Media  and  Adult  Education.  7  f  n.  ^*7.S^. 
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Table  1 

Correct  Answer  Means  by  Cognitive  Style  and  Treatment 


Overall 

N  Mean  Dependency 

Field  Independent                   47  I.54 

Non-subliminal                   28  1.29 

Subliminal                         19  1.79 

Neutral                               45  1  j4 

Non-subliminal                   22  1.36 

Subliminal                        23  0.91 

Field  Dependent                     40  1.05 

Non-subliminal                    19  1.00 

Subliminal                        21  L09 


480 

ERIC  478 


Table  2 


Analysis  of  Variance 


Field  Dependency 
Treatment 

Dependency  x  Treatment 

Model 

Error 

Total 


*p  >  .05 
**p  >  .01 
♦♦♦p  >  .001 


df 

ss 

MS 

F 

2 

4.875 

0.70 

1 

0.077 

0.02 

2 

5.169 

0.74 

5 

10.120 

2.024 

126 

441.599 

3.505 

131 

451.720 
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Although  the  computer  screen  and  printed  page  are  both  used  to 
present  text,  there  are  unique  qualities  and  constraints  the  designer 
must  consider  when  working  with  each  (Hartley,  1987).    A  review 
commercial  software  packages  will  reveal  that  the  ccmiputer  screen  is 
frequently  treated  as  an  electronic  representation  of  the  printed  page 
(Bork,  1987;  Burke,  1981;  Keller,  1987)  with  the  designer  attempting  to 
follow  the  same  rules  and  heuristics  that  have  guided  both  the  design 
and  layout  of  printed  information.    Comparisons  between  microtext  and 
print  on  difficulty  and  reading  speed  have  yielded  mixed  results  (Barbe 
&  Milone,  1984;  Fish  &  Feldmann,  1987;  Hansen,  Doring,  fc  Whitlock,  1978; 
Heppner,  Anderson,  Farstnq),  &  Weiderman,  1985;  Morrison,  Ross,  & 
O'Dell,  in  press;  Muter,  Latremouille,  &  Tremmiet,  1982),  but  an 
apparent  limitation  of  many  of  these  studies  is  the  failure  to  design 
the  text  displays  in  a  manner  that  fits  each  medium.    Fish  and  Feldnan 
(1987)  lor  exa^>le,  made  their  prini  pages  diQ>lications  of  their 
computer-based  instruction  (CBI)  screens,  a  procedure  that  adds  rigor  to 
the  c<»parison,  but  little  realism. 

Constraints  imposed  by  the  computer  display  include  (a)  a  display 
limited  to  one  page  at  a  time,  (b)  restricted  backward  paging  and 
review,  (c)  page  layouts  in  either  40  or  &D  columns  by  24  lines,  (d) 
limited  cues  as  to  lesson  length,  and  (e)  relatively  poor  resolution. 
Advantages  of  the  con^uter  include  the  ability  to  create 
response-sensitive,  highly  flexible,  and  dynamic  displays  without  cost 
constraints  on  the  use  of  color  or  number  of  pages.    Recent  suggestions 
for  the  design  of  computer  displays  emphasize  minimizing  the  amount  of 
text  presented  by  using  wide  margins,  double-spacing,  and  fade-out  of 
unneeded  information  (Allessi  &  Trollip,  1985;  Bork,  1987;  Grabinger, 
1983).    Implementation  of  these  guidelines,  however,  has  the 
disadvantage  of  requiring  an  increased  number  of  frames  to  display  the 
same  amount  of  information.    It  seems  both  theoretically  and  practically 
important  to  explore  ways  of  using  screen  display  areas  efficiently. 

The  research  described  in  this  paper  was  designed  to  identify 
alternative  methods  for  displaying  computer  text.    Its  specific  focus 
was  on  the  level  of  "richness"  or  detail  presented  in  each  display,  a 
variable  that  we  have  labeled  "density  level."    In  related  research  with 
print  material,  Reder  and  Anderson  (1980;  1982)  compared  complete 
chapters  from  college  textbooks  to  summaries  of  the  main  points  on  both 
direct  and  indirect  learning.    The  summaries  were  found  comparable  or 
8iq>erior  in  10  studies  reported.    They  concluded  that  the  summaries  may 
help  the  learner  focus  on  the  main  ideas  without  the  distraction  of 
additional  elaborations. 

Similar  to  Reder  and  Anderson's  (1980;  1982)  construct,  the  present 
text  density  variable  includes  such  attributes  as  length  of  material 
(number  of  words),  redundancy  of  ideas,  and  depth  of  conceptual  support 
for  the  main  ideas.    Reading  researchers  have  referred  to  such  text 
attributes  as  "microstructure"  (Davidson  &  Kantor,  1982).  Following 
Reder  and  Anderson's,    procedure  we  generated  low-density  material  from 
convent?.onal  text  by:     (a)  defining  a  set  of  rules  for  shortening  the 
text,  (b)  having  two  individuals  apply  the  rules  to  the  rewriting  of  the 
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text 9  and  (c)  requiring  those  individuals  to  arrive  at  a  consensus  on 
the  content  of  the  summary.    The  specific  sidelines  for  shortening  the 
text  were  as  follows: 

1^      Reduce  the  sentences  to  their  main  ideas. 

a.  Remove  any  unnecessary  modifiers,  articles  or  phrases. 

b.  Split  complex  sentences  into  single  phrases. 

2.  Use  an  outline  form  instead  of  a  paragraph  form  where 
^propriate. 

3.  Delete  sentences  that  summarize  or  amplify  without  presenting 
new  information. 

4.  Present  information  in  "frames"  containing  limited  amounts  of 
new  information,  as  in  programmed  instruction. 

Applying  these  rules  to  a  textbook  unit  of  instruction  consisting 
2,123  words  on  18  pages  yielded  a  final  low-density  version  consisting 
of  1,189  words,  a  56X  savings  on  15  pages,  a  17%  savings.    In  designing 
the  final  lessons,  a  critical  decision  was  whether  to  match  print  pages 
to  CBI  screens  in  order  to  maximize  their  similarities  for  analyzing 
media  differences.    We  decided  instead  to  sacrifice  internal  validity  to 
create  highly  realistic  page  and  screen  designs  for  evaluating  text 
density  effects'  (with  hi^  external  validity)  within  each  medium. 
Accordingly,  print  pages  and  computer  frames  were  designed  using  what 
were  subjectively  determined  to  be  the  most  appropriate  layouts  for  the 
content.    Final  versions  of  the  CBI  lessons  resulted  in  49  frames  in  the 
low-density  lesson  and  66  frames  in  the  high-density  lesson.    Figure  1 
shows  a  sample  frame  from  the  two  density  levels.    Both  frames  present 
the  same  main  ideas,  however,  the  high-density  version  includes 
additional  elaborations  and  supporting  context. 


Insert  Figure  1  about  here 


Our  main  research  interest  was  testing  the  effectiveness  of  the 
low-density  materials  Just  described.    Low-density  narrative  was 
hypothesized  to  promote  better  learning  and  more  favorable  attitudes  on 
CBI  lessons  by  reducing  reading  and  cognitive  processing  demands  of  the 
screen  displays.    A  second  area  of  interest  was  the  effect  of  learner 
preferences  for  the  two  density  levels  in  the  print  and  CBI  modes. 
Prior  research  on  learner  control  (LC)  has  shown  positive  results  in 
some  studies  (Judd,  Bunderson,  &  Bessent,  1970),  while  more  recent 
findings  have  been  negative  (Carrier,  Davidson,  &  Williams,  1985; 
Fisher,  Blackwell,  Garcia,  &  Greene,  1975;  Ross  &  Rakow,  1981;  Tennyson, 
1980).    In  contrast  to  typical  uses  of  learner  control  for  selecting  the 
quantity  or  difficulty  of  materials,  the  text  density  variable 
represents  a  **contextual"  lesson  property  that  would  seem  primairily 
oriented  in  subject-matter  to  accommodating  differences  in  reading 
ability  and  learning  styles  (rather  than  ^titudes  or  abilities).  Thus, 
it  appeared  worthwhile  to  explore  as  a  learner  control  option.  To 
investigate  these  questions,  we  conducted  an  initial  study  (Mcrrison  et 
al,  in  press),  which  is  summarized  below. 
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Study  I 

Subjects  were  48  undergraduate  teacher  education  majors  who  were 
randomly  assigned  to  six  treatment  groups.    The  treatment  groups  were 
arranged  by  crossing  two  presentation  modes  (computer  vs.  print)  by 
three  text  density  conditions  (high,  low,  and  learner  control). 
Dependent  variables  were  different  types  of  learning  achievement 
(knowledge,  calculation,  and  transfer),  lesson  coiqpletion  time,  and 
learning  efficiency.    During  a  regular  class  meeting,  subjects  completed 
a  brief  survey  to  asses  attitudes  towards  mathematics  and  CBI.  They 
then  attended  small-group  sessions  in  which  they  completed  the 
instructional  unit  followed  by  an  attitude  survey  and  an  achievement 
posttest. 

Results  indicated  the  high-density  and  low-density  materials  were 
selected  almost  equally  by  the  combined  CBI-  and  print-LC  groups  (n=16). 
The  print  group  selected  low-density  text  an  average  of  3.75  (out  of  5) 
times  while  the  CBI  group  selected  high-density  an  average  of  3.75 
times,  the  exact  opposite  pattern.    Achievement  results  indicated  the 
print  group  performed  significantly  better  on  the  knowledge  subtest 
(definitions)  and  on  the  calculation  subtest.    No  significant  density 
level  effects  occurred.    Print  subjects  (M=18.0  min.)  took  significantly 
less  time  to  complete  the  lesson  than  did  CBI  subjects  (M=32.3  min.), 
and  the  low-density  group  (M=20.8  min.)  took  less  time  than  the 
high-density  group  (M=27.8  min.).    With  regard  to  attitudes, 
high-density  print  subjects  perceived  the  lesson  as  moving  faster  than 
did  CBI  subjects.    Also,  low-density  CBI  subjects  rated  the  materials 
higher  in  sufficiency  than  did  the  print  subjects. 

These  results  were  consistent  with  those  obtained  for  college 
textbooks  (Reder  and  Anderson,  1980;  1982)  by  indicating  that 
low-density  materials  were  Just  as  effective  for  learning  as 
high-density  materials.    Also  of  interest  was  the  LC  density  selection 
pattern  showing  the  print  group  to  prefer  low-density  material  and  the 
CBI  group  to  prefer  high-density  material.    This  pattern,  along  with  the 
very  slow  pacing  by  the  CBI  group,  might  indicate  a  lack  of  confidence 
by  the  latter  in  using  the  computer  to  learn.    The  results  of  the 
attitude  survey  indicated  differences  in  the  way  the  media  and  density 
levels  were  perceived.    Print  subjects  Judged  the  high-density  material 
as  moving  faster  than  did  the  CBI  subjects.    This  perception  may  have 
been  due,  in  part,  to  the  difference  in  the  number  of  words  viewed  at  a 
time  (e.g.,  page  density)  in  the  two  different  modes.    That  is,  with  the 
realistic  display  formats  used,  CBI  subjects  were  required  to  view 
almost  four  times  as  many  "pages"  as  were  print  subjects.  Another 
significant  difference  was  that  the  CBI  subjects  rated  low-density 
material  as  more  sufficient  than  did  print  subjects.    Thus,  while  high- 
and  low-density  materials  had  comparable  influences  on  learning,  "less" 
was  perceived  as  "more"  in  the  CBI  mode. 

A  major  limitation  of  this  study  was  the  low  n  (only  8  per  cell) 
which  obvioxisly  reduced  the  sensitivity  of  the  various  hypothesis  tests. 
Other  limitations  were  the  lack  of  a  pretest  for  evaluating  the  initial 
knowledge  of  the  groups  and  a  delayed  posttest  to  assess  long-term 
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achievement*    The  results  also  raise  some  interesting  questions 
regarding  the  effectiveness  of  the  LC  strategy.    Overall »  and  in 
contrast  to  the  pattern  in  other  studies  (Hannafiny  1984) » 
low-performers  did  not  seem  to  favor  the  "low-support"  option  (i.e., 
loi^density)  text  over  higher  support.    High-density  text  was  actually 
the  predominant  choice  in  the  CBI  condition  in  which  achievement  scores 
were  lowest.    Further,  although  no  significant  differences  were  found, 
learner-control  was  directionally  highest  for  print  subjects  and  second 
highest  (below  low-density)  for  CBI  subjects  on  all  achievcsment 
subtests.    These  results  suggested  a  further  examination  of  the 
learner-control  strategy  using  a  larger  n. 

Study  II 

Study  II  (Ross,  Morrison,  O'Dell,  1987)  extended  Study  I  in  several 
ways.    First,  comparisons  between  density  and  presentation  modes  were 
replicated  with  larger  samples,  an  immediate  achievement  posttest,  and  a 
delayed  achievement  posttest.    Second,  the  examination  of  learner 
control  was  extended  to  include  selections  of  both  text  density 
("partial-LC**)  and  presentation  mode  ("full-LC").    Specifically,  as  in 
Study  I  the  partial-LC  treatment  allowed  subjects  to  select  either  a 
high-density  or  a  low-density  presentation  in  the  print  and  CBI  mod^s. 
Subjects  in  full-LC  treatment,  however,  were  allowed  to  first  select 
either  the  print  or  CBI  mode,  and  to  then  select  a  high-density  or 
low-density  presentation  within  the  selected  mode.    A  third  major 
interest  was  examining  the  relationship  of  individual  difference 
variables  of  reading  ability  and  prior  achievement  to  learning  from 
"conventional"  (high-density)  coinputer  text  displays. 

Subjects  were  221  undergraduate  teacher  education  students.  They 
were  randomly  assigned  to  the  seven  treatment  groups  arranged  according 
to  a  2(presentation  mode:  computer  or  print)  x  3(density:  high,  low,  or 
LC)  factorial  design  with  one  outside  condition  (full-LC).  Seventy-five 
subjects  from  the  total  pool  were  preassigned  to  the  high-density  CBI 
treatment  to  support  the  supplemental  analysis  of  individual  differences 
and  learning  in  that  treatment.    Prior  to  the  instructional,  session, 
subjects  corapleted  a  preattitude  survey,  pretest  on  the  instructional 
unit,  and  the  Nelson-Denny  Reading  Test  (Brown,  1976).    During  the 
instructional  session,  they  completed  the  \init  on  central  tendency  used 
in  Study  I,  the  attitude  survey,  and  the  achievement  posttest.  A 
delayed  posttest  was  administered  approximately  two  weeks  later. 

Comparisons  of  the  full-  vs.  partial-LC  conditions  found  no 
significant  differences  due  to  LC-strategies  on  achievement,  attitudes, 
density  selections.    There  was,  however,  a  significant  interaction  on 
completion  time  between  LC-strategy  and  presentation  medium.    Under  CBI, 
the  full-LC  group  (M=18.9  min.)  took  significantly  less  time  than  the 
partial-LC  group  (M=29.0  min.),  indicating  that  those  who  selected  CBI 
completed  the  lesson  more  quickly  than  those  who  were  prescribed  CBI. 
In  the  full-LC  treatment,  subjects^  choice  of  mode  was  almost  eqxially 
divided  between  print  (n=ll)  and  CBI  (n=13).      A  discriminant  analysis 
identified  reading  rate  to  be  a  significant  discriminator  between  those 
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who  selected  CBI  and  those  who  selected  print*    Subjects  selecting  CBI 
had  a  higher  reading  rate  than  those  who  selected  print.    Analysis  of 
the  number  of  low-density  selections  made  by  all  LC  subjects  showed  a 
general  tendency  for  subjects  to  select  low^density  text  (on  about  70 
percent  of  the  trials)  regardless  of  presentation  node.    In  multiple 
regression  analysis ,  reading  rate  again  was  found  to  be  the  only 
significant  predictor.    As  reading  skills  decreased,  the  tendency  to 
select  low-density  material  also  decreased. 

Significant  density  effects  on  achievement  occurred  on  the 
calculation,  transfer,  and  delayed  retention  measures.    In  all  cases, 
the  LC  group  had  the  highest  mean  of  the  three  treatments  with  a 
significant  advantage  indicated  on  the  latter  two  measures.  The 
presentation  mode  variable  in  contrast,  had  generally  small  effects, 
only  one  of  one  of  which  was  significant:  CBI  surpassed  print  on  the 
delayed  posttest. 

Analysis  of  completion  times  indicated  that  the  CBI  group  (N=25.8 
min.)  took  significantly  more  time  than  the  print  groiq>  (M=21.5  min.), 
and  the  high-density  group  (M=26.5  min)  took  significantly  more  time 
than  the  low-density  group  (M=21.0  min).    When  the  means  for  the  CBI 
mode  were  adjusted  to  account  for  delays  due  to  keypressing  and  screen 
construction,  the  presentation  mode  effect  was  no  longer  significant; 
however,  the  significant  density  condition  was  maintained. 

The  relationship  between  learner  characteristics  and  learning  from 
high-density  CBI  was  analyzed  using  a  stepwise  multiple  regression. 
When  immediate  posttest  scores  were  treated  as- the  criterion,  reading 
comprehension  was  the  first  predictor  entered  in  the  equation  with 
pretest  score  entered  on  the  second  step.    No  other  predictors  were 
entered.    In  contrast,  reading  scores  were  not  selected  as  predictors  in 
any  other  treatment  group  equatic.:is,  while  pretest  was  a  consistently 
strong  predictor  in  each. 

The  lack  of  difference  between  density  levels  is  consistent  with 
the  results  of  Study  I  and  of  Anderson  and  Reder's  (1980;  1982) 
research.    An  advantage  of  the  low-density  text  was  the  significant 
reduction  in  lesson  time  without  an  associated  reduction  in  learning. 
Results  of  the  LC  comparisons  further  suggested  that  learners  are 
capable  of  making  appropriate  decisions  when  selecting  contextual  lesson 
attributes  such  as  presentation  mode  or  text  density  level.  This 
finding  is  in  contrast  to  negative  results  from  LC  applications  which 
required  learners  to  select  the  sequence,  difficulty,  or  the  amount  of 
instructional  support  they  needed  to  achieve  objectives  (Hannafin, 
1984).    Accordingly  more  skilled  readers  tended  to  select  low-density 
text  while  less  skilled  readers  tended  to  select  high-density  text, 
seemingly  desirable  strategies  for  both  groups.    This  pattern  coupled 
with  the  tendency  to  vary  selections  across  lessons,  suggests  that  the 
subjects  attempted  to  adapt  instructional  demands  to  match  specific 
needs  as  learning  occurred. 
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Study  III 

A  confounding  variable  in  the  CBI  density  comparisons  of  Studies  I 
and  II  was  screen  density,  the  proportion  of  the  display  area  containing 
characters  as  opposed  to  white  space.    Specifically,  the  frame 
structures  into  which  the  high-  and  low-density  lessons  were  logically 
organized  naturally  resulted  in  sparser  screens  with  the  latter 
(low-density)  material*    Were  the  reactions  to  the  density  variations  by 
LC-subjects "primarily  determined  by  the  reduced  content  (text  density) 
or  by  the  less  cluttered  screens  (screen  density)?.    As  a  first  step 
toward  answering  this  question,  Study  III  was  designed  to  examine  what 
screen  density  levels  for  displaying  textxial  material  are  most  appealing 
to  learners. 

Prior  research  in  the  area  of  human  factors  engineering  has 
produced  several  recommendations  on  this  issue.    Screen  density  is  the 
amount  of  the  screen  actually  used  to  display  text  or  graphics,  for 
example,  a  40-column  by  24-row  screen  can  display  a  maximum  of  960 
characters.     Danchak  (1976)  recommends  a  maximum  screen  density  of  25X 
while  most  screens  judged  as  "good"  had  a  density  of  15X.    NASA  (1980) 
recommends  that  screen  density  not  exceed  60X.    Smith  (1980:  1981;  1982) 
recommends  a  maximum  screen  drasity  of  31. 2X  and  a  minimum  of  15. 6X  for 
80  column  screens. 

Using  these  reccnnmendations  as  a  guide,  we  designed  a  study  to 
determine  which  density  level  was  most  preferred  by  our  learners.  A 
possible  limitation  in  typical  studies  of  screen  density  preferences  is 
the  procedure  of  having  subjects  react  to  isolated,  individual  screens 
represented  in  the  different  density  gradients.    In  cases,  such  as 
Grabinger's  (1983)  study,  symbolic  notation  (Twyman,  1981)  rather  than 
approximations  to  English  (c.f.  Morrison,  1986),  or  actual  lesson 
content  comprises  the  "text.**    Would  format  preferences  be  the  same  with 
realistic  content  than  with  artificial  prototypes?   More  specifically, 
in  actual  lessons,  creating  sparcer  displays  will  necessarily  require  a 
greater  nund^er  of  screens.    Does  low-screen  density  seem  as  attractive 
to  the  student  considering  that  tradeoff? 

Subjects  in  this  preliminary  experiment  were  35  education  majors 
consisting  of  14  undergraduates  and  21  graduate  students,  and  26  females 
and  9  males.    The  stimulus  materials  consisted  of  the  same  text  content 
(from  the  central  tendency  lesson)  presented  in  four  different  screen 
density  levels.    The  ** conventional"  frame  consisted  of  definitions  of 
mean,  median,  and  mode  (see  Figure  2)  presented  on  a  single  frame.  When 
counting  all  letters  and  spaces  contiguous  with  letters,  the  screen 
represented  a  density  of  53%.    This  screen  was  then  systematically 
divided  into  logical  chunks  to  produce  screens  representing  densities  of 
31% f  26X,  and  22X.    The  text  for  31%  density  required  two  screens,  the 
2SX  density  required  3  screens,  and  the  22%  density  required  4  screens. 
It  should  be  noted  that  the  inclusion  of  additional  screens  tc  maintain 
equivalent  content  across  variations  presents  a  contrast  with  typical 
methodologies  in  which  individual  screens  (an  thus,  varied  amounts  of 
total  content)  are  judged.    A  paired-comparison  design  (Nunnally,  1967) 
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was  employed  involving  a  total  of  6  comparisons  presented  in  random 
order  on  an  Apple  //e  monochrome  screen. 


Insert  Fi^re  2  about  here 


The  data  were  scaled  using  the  procedures  described  by  Thurstone 
(1927).    Results  as  shown  in  Figure  3,  indicated  that  the  31%  density 
level  was  preferred  over  the  other  3  density  levels  (]><  .10). 
Interestingly,  these  results  suggest  that  subjects  prefer  to  read  two 
screens  of  information  {31%  density  level)  as  opposed  to  1  screen  with 
the  53%  density  level.    Similarly,  subjects  may  have  felt  there  was  too  - 
little  information  on  the  26%  (3  screens)  and  22%  (4  screens)  density 
screens  for  the  effort  of  paging  through  the  information.    The  31% 
density  level  may  provide  an  optimum  density  level  which  allows  the 
designer  to  make  effective  use  of  both  horizontal  and  vertical 
typography  to  organize  the  material  into  a  pleasing  screen. 


Insert  Figure  3  about  here 


Discussion 

In  this  closing  section  of  the  paper  we  will  discuss  implications 
of  our  studies  of  screen  and  text  density  in  CBI.    The  three  areas 
addressed  are  screen  design i  learner  control,  end  adaptive  design 
strategies. 
Screen  Design 

The  CBI  screen  presents  the  designer  with  a  format  that  imposes 
several  limitations  not  found  in  printed  text,  yet  it  offers  several  new 
possibilities  for  tb^  display  of  instructional  information. 
Specifically,  computer  screens  offer  alternatives  for  gaining  and 
redirecting  attention,  and  cueing  (flashing,  inverse  type,  animation, 
and  sound) .    Computer  displays  are  dynamic  in  that  a  designer  can  build 
a  screen  in  segments  to  emulate  the  content's  structure,  or  reconstruct 
only  parts  of  a  screen  for  comparisons.    The  unique  limitation  of  the 
CBI  frame  is  the  amount  of  information  that  can  be  displayed  with  a  40 
or  80  column  by  24  row  grid.    Following  a  traditional  page  format  for 
CBI  frames  results  in  either  very  dense  displays  or  inordinately  long 
lessons.    Such  designs  have  prompted  Tullis  (1981)  and  Kerr  (1986)  to 
suggest  research  is  needed  to  determine  the  appropriate  amount  of  text 
density  for  screen  displays. 

Our  research  on  low-density  text  suggests  that  this  format  is  a 
viable  alternative  to  the  standard  text  format  used  in  printed 
materials.    A  frame  designed  with  low-density  text  can  incorporate  white 
space,  double-spacing,  and  headings  adequately  in  a  single  frame.  This 
leaner  screen  provides  the  designer  with  the  space  needed  to  organize 
text  which  increases  its  visual  appeal  (Grabinger,  1985),  while 
minimizing  the  total  number  of  screens  required  to  present  the  same 
content,  another  attractive  feature  (see  Study  III).    Ample  use  of  white 
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spacet  and  vertical  and  horizontal  typography  with  low-density  text  will 
typically  produce  a  unit  of  instruction  that  is  comparable  in  frame 
length  to  the  high^-density  text,  but  with  approximately  SOX  fewer  words* 
Our  research  found  the  low-density  text  was  read  faster  and  perceived  as 
more  sufficient  than  the  same  text  presented  in  a  print  format* 
learner  Control 

Research  on  learner  control  (e.g.,  Tennyson,  1980;  Ross  &  Rakow, 
1981;  1982;  Hannafin,  1984)  has  previously  e^>loyed  learner  selections 
of  the  amount  or  difficulty  of  instructional  support  needed  to  achieve 
objectives.    Learners  were  frequently  found  to  sake  both  inefficient  and 
inappropriate  choices,  with  high  achievers  selecting  too  much  siq>port 
aVid  low-achievers  too  little.    In  contrast,  text  density  simply 
manipulates  the  context  of  the  lesson  information  as  opposed  to  the 
number  of  examples  or  elaborations  presented.    Thus,  it  comprises  a 
'^stylistic"  property  of  the  lesson  which  LC  subjects  could  vary  based  on 
preferences  and  reading  skills,  without  necessarily  having  high 
abilities  in  or  previous  experience  with  the  subject  being  taught. 

Our  research  on  learner  control  using  text  density  as  the  decision 
variable,  found  the  learner  control  groups  learned  better  than  groups 
receiving  standard  materials.    The  results  indicated  that  the  less 
skilled  readers  typically  selected  high-density  text  while  the  skilled 
reader  selected  low-density  text.    Implications  from  these  results  with 
information  that  that  subjects  varied  their  selections  across  units 
suggests  that  text  density  and  other  contextual  variables  can  be  used  as 
an  effective  learner  control  variable  in  CBI  (see  also  Ross,  1983). 
Text  Density  rs  an  Adaptive  Strategy 

Future  research  should  further  investigate  the  use  of  text  density 
as  a  learner-control  variable  versus  Sue  use  of  program  control  or 
advisement.    Such  research  holds  the  potential  for  developing 
prescriptions  for  text  density  based  on  levels  of  prior  achievement  and 
reading  ability  to  provide  for  more  efficient  instruction.    For  example, 
initial  text  density  levels  could  be  established  on  the  basis  of  a 
pretask  measures  so  as  to  match  the  density  level  with  the  learner's 
characteristics.    Text  der.sity  could  also  be  adapted  online  using 
procedures  similar  to  thofie  described  by  Tennyson  (1984)  in  the  MAIS. 
Again,  the  initial  text  density  level  could  be  established  on  the  basis 
of  prior  experience  or  reading  ability.    During  the  lesson,  the 
management  system  would  monitor  performance  and  time-on-task,  and  use 
the  data      make  appropriate  changes  in  density  level  throughout  the 
lesson.    If  a  student  were  taking  longer  than  the  established  mean,  the 
management  program  might  switch  to  low-density  to  isQ>rove  the  student's 
efficiency.    Other  research  might  investigate  the  use  of  high-density 
text  during  the  initial  stages  of  the  lesson  and  then  the  gradual 
transition  to  low-density  text  as  learner  performance  improves. 
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The  median,  another  measure  of  central  ^nd^Jlf  V- f  ^ 
corresponds  to  the  middle  frequency  (that  is,  the  middle  score)  in  a 
fankS  of  data.  The  median  is  the  value  that  divides  your 
SSutionrhalf;  half  of  the  scores  will  be  higher  than  the  median, 
and  half  will  be  lower  than  the  median. 
X  f 

Hi  50% 
Median  -^'J 

It  i<5  imDoriant  to  remember  that  the  median  is  the  halfway  point  in  the 
J  SoS  -^^  ei^r  For  example,  if  N=40  (meaning 

tl^at  you  have  40  scores),  tfie  median  will  be  your  20th  score  in  terms 
of  rank);Xl7.  the  m^ian  will  be  your  8.5  highest  score,  etc. 

Another  way  of  defining  the  median  is  to  say  that  it  corresponds 
to  the  50th  percentile. 

In  any  distribution,  the  median  will  always  be  the  score  that 

corr  Jponds  to  a  percentile  rank  of  50;  it  is  higher  than  half  the  scores. 

and  lower  than  half  the  scores.  


Figure  1.    Sample  text  density  screens. 
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Whenever  possible,  it  is  always  desirable  to  report  all 
three  measures  of  central  tendency. 
They  provide  different  kinds  of  information. 

The  MEAN  is  the  score  point  at  which  the  distribution  balances. 
The  MEDIAN  is  the  score  point  that  divides  the  distribution  in  half. 
The  MODE  is  the  highest  frequency  score. 

In  general,  however,  the  mean  provides  the  most  useful  measure 
of  central  tendency  by  taking  into  account  the  the  value  of  every 
score 
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Figure  3.    Scale  of  screen  density  preference 
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Abstract 


While  the  microcomputer  has  the  potential  of  becoming  a  most 
effective  teaching  tool/aid,   many  studies  reveal  no  significant 
differences  in  learning  occurring  due  to  instruction  by 
microcomputer.   It  is  believed  thai  the  design  of  current 
instructional  software  fails  to  accommodate  major  individual 
differences  in  learning  styles.     Locus  of  control   (LOG)  and  its 
effect  on  learner  performance  during  computer  assisted  instruction 
(CAI)  given  varied  feedback  strategies  are  investigated  in  th"s 
study.    It  is  hypothesized  that  learners  who  attribute  their 
failures  and  success  to  internal  evonts   (Internals)  will  perform 
best  under  delayed  feedback  conditions  while  those  who  attribute 
successes  and  failures  to  external  events  (Externals)  will  perform 
best  given  immediate  feedback.     In  addition,    it  is  hypothesized 
that  there  is  significant  interaction  of  feedback  on  LOG. 

Junior  high  school  students  from  three  8th  and  9th  grade 
classes  were  given  the  Intellectual   Achievement  Responsibility 
Questionnaire  to  determine  LOG.     Treatment  consisted  of  giving 
immediate,   delayed  and  no  feedback  during  GAI  to  each  group  of 
students  identified  as  having  internal  or  external  LOG.     Tests  for 
recall  and  retention  were  admu^aistered. 

A  t-test  compared  the  means  of  performance  scores  (independent 
variable)   on  tests  for  recall   (Tl)  and  retention   (T2)  between  the 
treatment  groups   (dependent  variable);    Immediate  (IFB),  Delayed 
(DFB)  and  No-feedback   (NFB),   for  2  LOG  groups   (dependent  variable); 
Internal  and  External.     A*  2x3  multivariate  analysis  of  variance 
(MANOVA)  tested  for  significance  of  interaction  between  the  three 
feedback  conditions  and  LOG.   The  results  indicated  the  Internals 
performed  significantly  better  than  the  Externals  on  DFB  on  the 
test  for  recall.     No  other  significant  differences  or  interaction 
were  found. 
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A  comparison  of  the  effects  of  locus  of  control  with  feedback 
strategies  on  factual  information  recall  and  retention 
during  computer  assisted  instruction 


Of  all  of  the  recent  in^iovations  in  education,  the 
microcomputer  possesses  those  attributes  which  most  closely 
resemble  the  human  instructor.     One  of  the  most  exciting  features 
offered  by  this  technology  is   its  capability  of  interacting  with 
the  learner.     The  learner  is  no  longer     passive,   but  active. 
Moreover,    the  microcomputer  can  present  information,   ask  questions, 
enable  the  student   to  respond,   give  feedback,   correct  errors  and  it 
can  even  remember  names. 

Most  often  cited  as  a  great  advantage  of  the  microcomputer  is 
its  ability  to  give  immediate  feedback •     The  assumpt ion  appears  to 
be  that  giving  immediate  feedback  is  critical   in  learning. 
However,  while  the  behaviorists  fully  support  the  immediate 
feedback/reinforcement   theory  of  learning,   many  studies  argue  that 
delayed  feedback  or  no  feedback  may  be  more  effective  feedback 
strategies . 

As  important  as  strategies  are,   however,   studies  show  that 
unless  the  learner  is  motivated  learning  will  not  occur. 
Motivation  may  be  external  and  internal,   however  more  specifically 
it  is  the  learner's  perception  of  the  events  that  cause  success  or 
failure  and  the  control  he  has  over  those  events  that  seem  to 
determine  the  amount  of  learning  that  occurs.     Studies  show  that 
learners  who  feel  responsible  for  their  own  successes  and  failures 
perform  better  given  delayed  feedback  or  no  feedback  while  those 
who  feel  other  persons  and  events  are  responsible  for  their 
successes  and  failures  have  been  found  to  perform  better  given 
immediate  feedback . 


In  instructional  design,   assessing  the  learner  is  st ressed 
(Heinich  &  Molenda,    1985;   Kemp  &  Dayton,    1985;   Locatis  &  Atkinson, 
1984),   however  the  underlying  assumption  in  a  majority  of  CAI 
programs:  available  for  use  in  the  classroom  today  is  that  most 
learn ing  is  achieved  through  the  use  of  small  s teps  and  immediate 
feedback  (Nishikawa,   1987).     Ploch  (1986)   places  partial 
responsibility  for  this   inconsistency  upon  the  developers  of 
software  who  are  usually  computer  programmers  and  not  educators. 

Feedback  strategies 

Behaviorists  claim  immediate  feedback/reinforcement  to  be 
appropriate  for  all   ins true t ion   (Skinner,    1954) .     Others  (Waldrop, 
Justen  &  Adams,   1986;   Kulhavy,   1977;   Surber  &  Anderson,  1975; 
Sassenrath,   1975;   Sassenrath  and  Yonge,   1968,   1969)   argue  that 
delayed  feedback  may  be  as  effective  and  more  efficient  than 
immediate  feedback  .     Moreover,   Karraker  (1967)   and  Lublin  (1965) 
have  found  that  with  particular  types  of  learners  under  certain 
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learning  conditions,   no  feedback  may  be  a  more  t.ppropriate 
strategy.     Kulhavy  (1977)  theorizes  that  "interference  due  to  error 
perseveration  is  reduced  if  people  are  given  a  chance  to  forget 
incorrect  responses"   (p.   223)  Studies  determining  the  effectiveness 
of  specific  types  and  amount  of  feedback  have  produced  mixed 
results  (Merrill,  1987;  Renzi,   1974;  Block  &  Tierney,   1974;  Tait, 
Hartley  &  A^iderson,   1973).     Annett  (1969)   attributes  the  difficulty 
of  conducting  such  efforts  to  the  transformations  that  have  evolved 
over  the  i-^ast  few  decades  in  educational   psychology  particularly  in 
feedback . 

Skinner  (195<i)  described  feedback  within  a  simple  stimulus- 
response  paradigw .  However ,   f eedback  is  now  believed  by  some 
researchers  (Powers,   1973)  to  be  behavior  in  itself.     Powers  (1973) 
theorizes  that  "stimuli  depend  on  responses  according  to  the 
current  organization  of  the  environment  and  the  body  in  which  the 
nervous  system  resides"   (p.   178)  and  that  an  individual  knows 
nothing  of  his  own  behavior  but  the  feedback  effects  of  his  own 
output.     Therefore,   according  to  Powers  (1973),   feedback  is 
behavior . 

Feedback  and  locus  of  control 

Concurrent  with  Powers*   position.   Snow  and  Salomon  (1968) 
maintain  that  learning  variables  within  an  individual  function 
selectively  and  that  an  individual's  development  is  a  critical 
learning  factor.     Bar-^Tal  and  Bar-Zohar  (1977)   in  their  review  of 
36  studies  on  the  relationship  of  perception  of  control  and 
achievement  report  a  firm*  trend  suggesting  that  for  persons 
attributing  failures  and  successes  to  self  achievement  was  higher. 
When  Baron  and  Ganz  (1972)  and  associates  (Baron,   Cowan,   Ganz  & 
MacDonald,   1972)  studied  various  feedback  strategies  using  academic 
achievement  as  a  dependent  variable,   significant  differences  were 
found  between  those  identified  as  attributing  the  consequences  of 
their  behavior  on  external  events  (Externals)  and  those  who 
accepted  the  responsibility  for  their  successes  and  failures 
(Internals).     It  is  suggested  that  by  early  adolescence  the  effect 
of  intrinsic  and  extrinsic  feedback  is  generally  governed  by 
variations  in  locus  of  control   (LOC).       Louie,   Luick  and  Louie 
(1985-86)  also  contend  that  these  perceptions  will  vary  fror  person 
to  person  and  within  an  individual  over  time. 

Feedback  and  CM 

More  recently  educational  research  has  attempted  to  determine 
the  effectiveness  of  the  microcomputer  used  in  the  instructional 
environment .   Some  researchers  (Tai  t  et  al ,   .1 973;   Cohen ,   1985 ; 
Albertson,   1986)  claim  instructional  design  of  CAI  generally 
inferior  as  reliance  is  placed  on  outmoded  theories  and  practice. 
Carrier  (1985)  emphasizes  that  educators  must  take  advantage  of  the 
microcomputer's  ability  to  collect  data,   respond  appropriately, 
diagnose  needs,   prescribe  instruction,   simulate  activities  and 
evaluate  sequences  among  other  characteristics  to  meet  individual 
learning  needs. 

The  study  of  feedback  strategies  in  instruction  by 
microcomputer  is  still  in  :ts  infancy.     In  one  study,  Cohen  (1985) 
discovered  that  the  greatest  effect  on  performance  resulted  from 
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information  feedback  given  after  incorrect  responses*  Feedback 
after  correct  responses  was  reportedly  unimportant  to  students  in 
certain  cases.     Cciien  (198t)  posits  that  feedback  after  a  correct 
response  may  cause  interference  in  learning,   particularly  with 
those  students  who  maintain  high  confidence  in  their  knowledge  of 
the  material*     Immediate  feedback  seemed  most  effective  only  in 
knowledge  acquisition  for  those  students  having  difficulty 
mastering  the  material* 

In  a  later  study,  Waldrop,   Justen  and  Adams  (1986)  varied  the 
amount  of  corrective  feedback  during  drill  and  practice  in  CAI  and 
found  that  immediate  extended  f eedback  fol lowing  both  correct  and 
incorrect  responses  is  superior  to  minimal  feedback  or  simply 
acknowledging  right  or  wrong  responses*     On  the  other  hand  delayed 
feedback  in  CAI  was  found  to  be  significantly  better  than  immediate 
feedback  in  a  study  by  Rankin  and  Treppcr  (1978)* 

Locus  of  control  and  CAI 

Cohen  (1985)  alludes  to  a  relationship  between  high  confidence 
in  the  knowledge  of  the  material  to  be  learned  and  the  need  for 
feedback.     Students  having  difficulty  mastering  the  material  seemed 
to  perform  better  given  immediate  feedback* 

Louie  et  al*    (1985-86)   studied  46  students,  9  to  15  years  of 
age,   of  high  socioeconomic  status  to  determine  whether  by  using 
Logo  and  Bank  Street  Writer  there  would  be  a  shift  in  LOC*  While 
the  results  are  questionable,   significant  shifts  were  found  in 
LOC*     In  a  study  by  Wesley  et  al*    (1985),  however,  no  main  effects 
and  no  interaction  of  LOC*  and  acquisition  of  science  process  skills 
during  CAI* 

As  the  use  of  microcomputers  increases,   concepts  such  as 
reinforcement,   feedback  and  LOC  need  to  be  more  clearly  defined 
Louie  et  al*    (1985-86)  states  that  "if  locus  of  control  does  play  a 
significant  part   in  the  child's  interpretation  of  reinforcement  and 
its  relationship  to  events  occurring  in  reality,   then  software 
design  should  be  influenced  in  the  light  of  such  research  findings" 
(p*107)* 

The  need  for  feedback  in  CAI  studies  is  strongly  urged  by 
Oilman  (1969)  and  others  (Cohen,   1985;   Hedberg  and  McNamara,  ; 
Merrill,   1983,   1987)*     Furthermore,  Merrill  (1987)  and  Cohen  (1985) 
express  the  need  for  better  and  more  efficient  CAI* 

The  new  technology  demands  that  developers  of  instruction 
integrate  current  research  findings  related  to  cognition  and 
instruction  (Costa,   1980)   into  instructional  design  of  CAI*  With 
the  high  potential  the  microcomputer  holds  as  a  teaching/learning 
tool  expanded  by  the  ease  of  current  assuring  systems,  the 
possibility  of  designing  diverse  instruction  to  meet  specific 
individual  needs  is  now  possible* 
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The  study 

Purpose 

This  study  was  designed  to  examine  the  effects  of  immediate, 
delayed  and  no  feedback  conditions  on  recall  and  retention  in  a 
computer  based  instruction  and  to  determine  whether  an  individual's 
LOG  significantly  interacts  to  affect  performance. 

It  was  hypothesized  that : 

1.  Given  immediate  feedback)   the  Externals  (learners 
identified  as  having  external  LOG)  will  perform  significantly 
better  than  the  Internals   (learners  identified  as  having  internal 
LOG)  on  the  tests  for  recall  and  retention. 

2.  Given  delayed  feedback^   the  Internals  will  perform 
significantly  better  than  Externals  on  the  tests  for  recall  and 
retention. 

3.  Given  no  feedback,   the  Internals  will  perform  significantly 
better  than  Externals  on  the  tests  for  recall  and  retention. 

4.  Significant  interaction  will  be  found  between  LOG  measures 
and  the  feedback  conditions. 

Location 

The  study  was  conducted  at  a  junior  high  school   in  a 
midwestern,  suburban  community  of  approximately  60,000.     The  school 
serves  a  middle  to  upper  middle  social-economic  population. 

Subjects 

Subjects  were  37  students  in  two  9th  grade  and  one  8th  grade 
Social  Studies  classes,   23  males  and  14  females. 

/ 

Microcomputers 

Twelve  Apple  II  and  lie  microcomputers  in  the  school  * s 
Microcomputer  lab  were  used  in  the  study.     The  arrangement  of  the 
equipment  permitted  students  to  work  independently. 

Questionnaire 

The  Intellectual  Achievement  Responsibility  Questionnaire 
(lARQ)  developed  by  Crandall,   Katkovsky  and  Grandall   (1965)  was 
used  to  measure  students*  beliefs  that  failures  and  successes  in 
achievement  are  caused  by  internal  or  external  factors.  The 
instrument  has  acceptable  reliability,  both  divergent  and 
convergent  validity  (MacDonald,   1973)   and  contains  34  f orced-^choice 
items.     A  total  of  24  or  less  identified  the  students  as  having 
external  LOG  and  26  or  more,   internal  LOG. 

Goroputer  assisted  instruction  (CAD* 

The  same  ins true t ion a 1  sequence  was  presented  under  three 
different  conditions:   immediate,   delayed  and  no  feedback.  The 
lessons  were  created  using  Super-Pilot,   an  Apple  authoring  software 
package.     In  order  that  the  instruction  could  be  easily  completed 
during  one  50-minute  period,   each  program  consisted  of  28  frames 
taking  about  20  minutes. 

Immediate  feedback  condit ion 

The  CAI  program  presented  text  and  graphics.   At  the 
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end  of  each  stepi   the  student  responded  to  a  question 
relative  'to  the  information,  was  Kiven 
praise/acknowledgment  of  correctness/ incorrectness  of 
answer  I  was  remediated  i  f  incorrect,   thon  instructed  to 
continue. 

Delayed  fe;edback  condition 

The  CAI  program  presented  identical  text  and 
graphics.     The  student  was  informed  in  the  introduction  to  the 
lesson  that  responses  to  questions  woui.d  not  be  acknowledged  at 
the  end  of  each  step  but  would  be  delayed  until  the  end  of  thv..- 
lesson.     Therefore,  at  the  end  of  each  step,   the  student 
responded  to  a  question  relat*^»e  to  the  information  but  was  not 
given  feedback  bt^fore  being  instructed  to  continue. 

No-   Redback  condition 

The  CAI  program  presented  identical  text  and  graphics. 
The  student  was  informed  in  the  introduction  to  the  lesson  that 
responses  to  questions  would  not  be  acknowledged.     At  the  end 
of  each  step  the  student  was  given  the  option  to  respond  or  not 
respond  then  instructed  to  continue. 

Immediate  test  for  recall 

A  15-item  paper  and  pencil  test  was  given  immediately  after  the 
CAI  instruction. 

One  week  test  for  retention 

A  similar  15-item  paper  and  pencil  t^st  was  given  a  week  after 
the  CAI  instruction. 

Experimental  schedule 

The  lARQ  was  administered  one  week  prior  to  the  CAI  testing. 
Students  were  divided  into  two  LOG  groups  according  to  scores  on 
the  lARQ  with  Internals  scoring  26  and  above  and  Externals  scoring 
24  and  less  on  a  scale  from  1-34.     Each  LOG  group  was  further 
subdivided  into  three  treatment  groups,   IFR,   DFB  and  NFB. 

On  the  day  of  the  instruction,  students  received  individual 
lesson  diskettes  identi f ied  by  previously  assigned  identification 
numbers  before  proceeding  to  the  microcomputers.     Since  there  was 
general   familiarity  with  the  use  of  the  equipment,   students  were 
asked  to  "boot"  the  program  by  simply  inserting  the  diskette  into 
the  disk  drive  and  turning  on  the  power  switch.   Each  of  the 
programs  directed  the  students  to  raise  their  hands  upon  completion 
of  the  instruction  to  signify  r-^ndiness  for  the  test  for  recall. 

Once  the  test  was  completed,   the  students  returned  to  the 
classroom.     Two  days  fol lowing  the  instruction  each  student 
received  the  results  of  the  test  and  corrective  information  to 
those  i tems  missed  on  the  test .     Seven  days  fol lowing  the  initial 
tes t ,  a  paper  and  pencil   test  for  retention  was  administered. 
Confidentiality  was  preserved  by  teacher  assigned  identification 
numbers . 
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Analysis  of  da  ta 


Perforwoncc  scores  on  the  lests  for  recall  (Tl)  and  retention 
(T2)  and  locus  of  control,   Internal  and  External,  were  the 
dependent  measures*     The  treatment,  consisting  of  of  immediate 
(IFB)>   delayed  (DFO)  and  no-feedback  (NFB)  conditions,  was  the 
independent  me«    ure.   t-tests  were  performed  to  detect  the  presence 
of  significant  differences  between  the  means  of  the  treatment 
groups  for  the  Internal  and  External  measures*     The  2x3 
multivariate  analysis  of  variance  (MANOVA)  was  used  to  test  for 
interaction  between  LOG  and  feedback* 


The  summary  of  cell  means  and  standard  deviations  for  the 
variables  are  presented  in  Table  1.     The  test  for  recall  (Tl)  and 
retention  (T2)  were  scored  on  the  basis  of  number  of  correct 
answers  out  of  a  possible  rr.aximum  of  15  items  for  *  ach  test.  Locus 
of  control  was  determined  by  scores  on  the  lARQ  with  Internals 
scoring  26  and  more  and  Externals  scoring  24  and  less  on  a  scale 
from  1-3^. 


Hypothesis  1.     Given  immediate  feedback,   the  Externals  wllJ 
perform  significantly  better  than  Internals  on  tests  for  recall  and 
retention  during  CAI. 

The  t-test  used  to  compare  the  means  of  performance  scores  of 
the  IFB  condition  on  the  Internals  and  Externals  indicated  no 
significant  difference  on  Tl,   t(Jl)=-0.11,   or  T2,  t(8)=-0.7l. 


Hypothesis  2.     Given  delayed  feedback,   the  Internals  Kill 
perform  significantly  better  than  Externals  on  tests  for  recall  and 
retention  during  CAI. 

The  t-tests  used  to  compare  the  means  of  perforhiance  scores  of 
the  DFB  condition  on  the  Internals  and  Externals  indicated  a 
significant  difference  in  performance  for  Tl ,  t(12)nl,90, 
No  significant  difference  was  noted  in  T2,   t(12)=1.56  (Table  2) 

Hypothesis  3.     Given  no  feedback,    the  Internals  will  perform 
significantly  better  than  the  Externals  on  tests  for  recall  and 
retention. 

The  t-test  used  to  compare  the  means  of  performance  scores  of 
the  NFB  condition  on  the  Internals  and  Externals  indicated  *io 
significant  difference  on  Tl ,   t(ll)=0.08,  or  on  T2,  t(ll)=-l.u4 
(Table  2). 


Results 


Insert  Table  1  here 


Insert  Table  2  hero 
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Hypothesis  4>     Significant  interaction  will  be  found  between 
LOG  measures  and  feedback  conditions. 

Neither  the  test  on  the  univariate  (Table  3)  nor  the  MANOVA 
using  Wilkes  test  of  significance  (Table  4)   indicates  the  presence 
of  any  interaction  between  LOG  and  feedback  conditions. 


Discussion 

The  results  of  the  t-tests  performed  on  the  treatment  variables 
provide  no  support  of  the  hypotheses  that  immediate  feedback  or  no- 
feedback  are  more  effective  conditions  or  that  they  are  better 
instruct ional  strategies  for  either  Internal  or  External  LOG 
learners.     However,   the  significant  difference  found  between  the 
performance  of  Internals  and  Externals  under  DFB  conditions 
(p=<.04)   indicates     LOG  learners  vould  be  more  likely  to  show 
better  performance  under  delayed  feedback  conditions  than  from 
either  immediate  or  no  feedback  conditions. 

In  earlier  LOG  by  academic  achievement  studies,   Grandall  and 
Battle  (1970),   Baron  and  Ganz   (1974)   and  Bar-Tal  and  Bal-Zohar 
(1977),  have  found  that  high  achievers  are  generally  Internals.  In 
addition  feedback  studies  show  delayed  feedback  to  be  more 
effective  for  certain  individuals   (Kulhavy,   1977;  Rankin  &  Trepper, 
1978). 

If,    indeed,   the  data  support  the  hypothesis  that  given  delayed 
feedback  Internals  will  perform  better  than  Externals,    it  could 
provide  some  insight  into  the  type  of  individual  who  benefits  from 
delayed  feedback.     Kulhavy's  (1977)   "interference  due  to  error 
perseveration"  phenomenon   (p.   223)  could  well  be  a  characteristic 
of  the  cognitive  process  experienced  by  the  Internal. 

Drawing  conclusions  regarding  achievement  and  locus  of  control 
from  this  study  or  any  study  must  be  done  cautiously  (Stipek, 
1980),   however.     It  is  the  contention  of  researchers  that  in 
addition  to  flaws  in  research  design  and  procedure  there  are  other 
variables  such  as  socioeconomic  conditions  (Grandall,  Katkovsky  & 
Grandall,   1965),   race  (Baron  et  al.,   1974),   and  sex  (Louie  et  al., 
1985-86)  which  operate  to  confound  any  set  of  data. 

While  comparable  results  are  described  in  other  studies  in 
feedback  strategies  in  instruction  and  the  effect  of   Locus  of 
control  in  academic  achievement  (Beck  &  Lindsey,   1979;  Kulhavy, 
White,   Topp,  Chan  &  Adams,    1985;  Bar-Tal  &  Bar  Zohar,   1977)  major 
limitations  contributed  to  the  contamination  of  the  present  study. 

1.  Small  sample  si;5e 

A  larger  sample  woul d  indeed  have  increased  the  power  of 
the  study.     Keppel   (1982)  suggests  that  a  2x3  factorial  design  have 
at  least  20  subjects  per  cell.     Although  contact  was  made  with  79 
students  in  this  study,   only  37  completed  all  phases  of  the  study. 
Absences  and  inat ten t i veness  were  primary  causes  of  attrition. 

2 .  Limited  instructional  time 

Permission  to  conduct  the  study  in  a  junioir  high  school 
classroom  was  obtained  contingent  upon  an  agreement  that  the  lARCr, 
the  lesson,   and  tests  for  recall  and  retention  take  no  longer  than 
70  minutes  on  three  given  days,   10  minutes  for  the  lARQ,  50  minutes 
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for  instruction  and  10  minutes  for  the  retention  test.  Instruction 
over  a  longer  period  of  time  would  have  produced  more  significant 
data. 

3.  Short  CAI  program 

In  order  that  the  students  spend  no  more  than  50  minutes  in 
the  microcomputer  lab,   it  was  necessary  to  limit  the  CAI  program  to 
28  frames  which  took  approximately  20  minutes  for  the  students  to 
complete.     The  narrow  range  of  performance  values  did  not  provide 
an  accurate  profile  of  knowledge  acquisition  or  retention, 

4.  Instruction  not  a  part  of  the  classroom  curriculum 

The  awareness  that  the  lesson  would  not  affect  students  * 
grades  appeared  to  have  impact  on  attitude  toward  the  instruction. 
Obvious  signs  of  relief  were  observed  when  students  were  told  the 
tests  would  not  be  graded. 

Conclusions 

In  spite  of  the  four  limitations  cited,   two  conclusions  are 
made.     The  first  relates  to  the  hypotheses  and  the  second  to 
experimental  design . 

The  data  indicates  a  need  for  further  research  on  the 
effectiveness  of  delayed  feedback  for  internal  LOC  learners.  Out 
of  the  four  hypotheses  presented,    the  results  showed  support  only 
for  the  delayed  feedback  as  an  effective  strategy  for  learners  who 
are  identified  as  Internals. 

From  this  study  it  is*  concluded  that  in  conducting  research  of 
this  nature,   it  would  be  valuable  for  researchers  to  be  aware  of 
the  processes  involved  in  obtaining  data  from  school  children  and 
the  yield  from  such  studies.     It  should  be  noted  that  seven  levels 
of  approval  had  to  be  met  before  experimentation  could  begin  and 
that  the  attrition  rate  was  53%  which  yielded  37  usable  data. 
Information  of  this  sort  is  just  as  necessary  in  interpreting  the 
results  of  studies  such  as  this  as  are  statistical  data. 
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Table  1 

Summary  of  cell  means  and  standard  deviations  of  Immediate 
(IFB),   Delayed  (DFB)  and  No-feedback  (NFB)  treatment  groups  on 
LOG  groups 

TEST  FOR  RECALL  (Tl)  


LOG      Treat»t      Mean  S,D,  W        95%  Gonf>  Interval 


Internal 

IFB 

12.714 

2.360 

7 

10.531 

14.897 

DFB 

13.556 

1.424 

9 

12.461 

14.650 

NFB 

12.429 

2.070 

7 

10.514 

14.343 

External 

IFB 

12.667 

1.528 

3 

8.872 

15.416 

DFB 

11.200 

3.271 

5 

7. 138 

15.262 

NFB 

12.333 

2.503 

6 

9.706 

14.960 

Entire 

Sample 

12.595 

2. 192 

37 

11.864 

13.325 

TEST  FOR  RETEWTIOW  (T2)  

LOG      Treatat      Mean  S.  D.  N  95X  Conf .  Interval 


Internal 

IFB 

8.429 

2.225 

7 

6.370 

10.487 

DFB 

10.667 

1.581 

9 

9.451 

11.882 

NFB 

7.857 

1.676 

7 

6.307 

9.407 

External 

IFB 

9.667 

3.215 

3 

1.681 

17.652 

DFB 

9.000 

2.449 

5 

5.959 

12.041 

NFB 

9.833 

2.639 

6 

7.063 

12.603 

Entire 

Sample 

9.270 

2.269 

37 

8.514 

10.027 
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Table  2 

Summary  of  cell  means,  standard  deviations  and  t-test  of  IFB,  DFB 
and  NFB  on  Internal  and  External  LOG 

TKST  FOR  RECALL  (Tl) 


Iwmediate 


LOG 

N 

Moan 

S.D. 

t-Value 

df 

Internal 

7 

12.714 

2.360 

-0.11 

11 

External 

3 

12.667 

1.528 

Total 

10 

12.700 

Mean  Difference 

0.047 

Delayed 

LOG 

N 

Mean 

S.D. 

t-Value 

df 

Internal 

9 

13.556 

1.424 

-1.90* 

12 

External 

5 

11.200 

3.271 

Total 

14 

12.715 

Mean  Difference 

2.356 

No-feedback 

LOG 

N 

Mean 

S.D. 

t-Value 

df 

Internal 

7 

12.429 

2.070 

0.08 

11 

External 

6 

12.333 

2.503 

Total 

13 

12.384 

Mean  Difference   0.  096 
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TEST  FOR  RETENTION  (T2) 
Inmediaic 


LOG 

N 

Mean 

S.D. 

t-Value 

df 

Internal 

7 

8.429 

2.225 

-0.71 

8 

External 

3 

9.667 

3.215 

Total 

10 

8.800 

Mean  Difference 

1.238 

Delayed 

LOG 

N 

Mean 

S.D. 

t-Value 

df 

Internal 

9 

10.667 

1.581 

1.56 

12 

External 

5 

9.000 

2.419 

Total 

14 

10.072 

Mean  Difference 

1.667 

No-Feedback 

LOG 

N 

Mean 

S.D. 

t-Value 

df 

Internal 

7 

7.857 

1.676 

-1.64 

11 

External 

6 

9.833 

2.639 

Total 

13 

8.769 

Mean  Difference 


1.976 
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Table  3 

Test  of  significance  of  interaction  between  Internal  and  External 
LOG  and  treatment  conditions  on  the  univariate 

TEST  FOR  RRCAI.l  (Tl) 

Factor  df  SS  MS  F  Signif.   of  F 

LOG  1  5.691  5.691        1.144  .293 

Treatment  2  .613  .307  .062  .940 

LOG  X  Treatment     2  10.418  5.209        1.047  .363 


TEST  FOR  RETENTION  (T2) 

FactfiE  df  SS  ?1S  F  Signif.   of  F 

LOG  1  2.184  2.184  .463  .501 

Treatment  2  6.827  3.413  .724  .493 

LOG  X  Treatment     2  23.225  11.612        2.464  .102 
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Table  4 

Wilk*s  multivariate  test  of  significance  for  LOG,  Treatment  and  LOG 
X  Treatment 


Factor 


Value 


df 


Signif.   of  F 


LOG  .889 
Treatment  ..'^20 
LOG  X  Treatment  .859 


2 
4 
4 


1.873 
.637 
1.  181 


.  171 
.645 
.328 
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Abstract 

While  the  Microconputer  has  the  potential  of  becoming  a  most 
effective  teaching  tool/aidy  many  studies  reveal  no  significant 
differences  in  learning  occurring  due  to  instruction  by 
microcomputer.  It  is  believed  that  the  design  of  current 
instructional  software  fails  to  accommodate  major  individual 
differences  in  learning  styles.     Locus  of  control   (LOG)  and  its 
effect  on  learner  performance  during  computer  assisted  instruction 
(CAI)  given  varied  feedback  strategies  are  investigated  in  this 
study. 

It  is  hypothesized  that  learners  who  attribute  their  failures 
and  successes  to  internal  events  (Internals)  will  perform  best 
under  delayed  feedback  conditions  while  those  who  attribute 
successes  and  failures  to  external  events  (Externals)  will  perform 
best  given  immediate  feedback.     In  addition,  it  is  hypothesized 
that  there  is  significant  interaction  of  feedback  on  LOG. 

Junior  high  school  students  from  three  8th  and  9th  grade 
classes  were  given  the  Intellectual  Achievement  Responsibility 
Questionnaire  to  determine  LOG.     Treatment  consisted  of  giving 
immediate,  delayed  and  no  feedback  during  GAI  to  each  group  of 
students  identified  as  having  internal  or  external  LOG.     Tests  for 
recall  and  retention  were  administered. 

A  t-test  compared  the  means  of  performance  scores  (independent 
variable)  on  tests  for  recall  (Tl)  and  retention  (T2)  between  the 
treatment  groups  (dependent  variable);  Immediate  (IFfi),  Delayed 
(DFB)  and  No-feedback  (NFB),  for  two  LOG  groups  (dependent 
variable);  Internal  and  External.     A  2x3  multivariate  analysis  of 
variance  (NANOVA)  tested  for  significance  of  .interaction  between 
the  three  feedback  conditions  and  LOG.  The  results  indicated  the 
Internals  performed  significantly  better  than  the  Externals  on  DFB 
on  the  test  for  recall.     No  other  significant  differences  or 
interaction  were  found. 
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Effects  of  feedback  strategies  in  computer  assisted 
instructi'^n  and  the  influence  of  locus  of  control 
on  the  perfornance  of  Junior  high  students 


Introduction 

Of  all  o/  the  recent  innovations  in  education,  the 
■icrocoaputer  possesses  those  attributes  which  most  closely 
resemble  the  human  instructor*     One  of  the  most  exciting  features 
offered  by  this  technology  is  its  capability  of  interacting  with 
the  learner*     The  learner  is  no  longer    passive,  but*,  active* 
Moreover,  the  microcomputer  can  present  information,  ask  questions, 
enable  the  student  to  respond,  give  feedback,  correct  errors  and  it 
can  even  remember  names* 

Most  often  cited  as  a  great  advantage  of  the  microcomputer  is 
its  ability  to  give  immediate  feedback*     The  assumption  appears  to 
be  that  giving  immediate  feedback  is  critical  in  learning* 
However,  while  the  behaviorists  tully  support  the  immediate 
feedback/reinforcement  theory  of  learning,  many  studies  argue  that 
delayed  feedback  or  no  feedback  may  be  more  effective  feedback 
strategies* 

As  important  as  strategies  are,  however,  studies  show  that 
unless  the  learner  is  motivated  learning  will  not  occur* 
Motivation  may  be  external  and  internal,  however  more  specifically 
it  is  the  learner's  perception  of  the  events  that  caus^  success  or 
failure  and  the  control  he  has  over  those  events  that  seem  to 
determine  the  amount  of  looming  that  occurs*     Studies  show  that 
learners  who  feel  responsible  for  their  own  successes  and  failures 
perform  better  given  delayed  feedback  or  no  feedback  while  those 
who  feel  other  persons  and  events  are  responsible  for  their 
successes  and  failures  have  been  found  to  perform  better  given 
immediate  feedback* 


Backifround 

In  instructional  design,  assessing  the  learner  is  stressed 
(Heinich  &  Molenda,   1985;  Kemp  &  Dayton,   1985;  Locatis  &  Atkinson, 
1984),  however  the  underlying  assumption  in  a  majority  of  CAI 
programs  available  for  use  in  the  classroom  today  is  that  most 
learning  is  achieved  through  the  use  of  small  steps  and  immediate 
feedback  (Nishikawa,  1987)*     Ploch  (1986)  places  partial 
responsibility  for  this  inconsistency  upon  the  devel  ^ers  of 
software  who  are  usually  computer  programmers  and  i^o.  educators* 

Feedback  strategies 

Behaviorists  claim  imviediate  feedback/reinforcement  to  be 
appropriate  for  all  instruction  (Skinner,   1954)*     Others  (Waldrop, 
Justen  &  Adams,   1986;  Kulhavy,   1977;  Surber  &  Anderson,  1975; 
Sassenrath,   1975;  Sassenrath  and  Yonge,   1968,   1969)  argue  that 
delayed  feedback  may  be  as  effective  and  more  efficient  '  'an 
immediate  feedback  «     Moreover,  Karraker  (1967)  and  Lublin  (1965) 
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have  found  that  with  particular  types  of  learners  under  certain 
learning  conditions,  no  feedback  may  be  a  more  appropriate 
strategy. 

Kulhavy  (1977)  theorizes  that  "interference  due  to  error 
perseveration  is  reduced  if  people  are  given  a  chance  to  forget 
incorrect  responses"  (p.   223)  Studies  determining  the  effectiveness 
of  specific  types  and  amount  of  feedback  have  produced  mixed 
results  (Nerrilli   1987;  Renzi,   1974;  Block  &  Tierney,   1974;  Tait, 
Hartley  &  Anderson,   1973).     Annett  (1969)  attributes  the  difficulty 
of  conducting  such  efforts  to  the  transformations  that  have  evolved 
over  the  past  few  decades  in  educational  psychology  particularly  in 
feedback. 

Skinner  ( 1954)  described  feedback  within  a  simple  stimulus- 
response  paradigm.  Jlowever,   feedback  is  now  believed  by  some 
researchers  (Powers,   1973)  to  be  behavior  in  itself.     Powers  (1973) 
theorizes  that  "stimuli  depend  on  responses  according  to  the 
current  organization  of  the  environment  and  the  body  in  which  the 
nervous  system  resides"  (p.   178)  and  that  an  individual  knows 
nothing  of  his  own  behavior  but  the  feedback  effects  of  his  own 
output*     Therefore,  according  to  Powers  (1973),   feedback  is 
behavior. 

Feedback  and  locus  of  control 

Concurrent  with  Powers'  position.  Snow  and  Salomon  (1968) 
maintain  that  learning  variables  within  an  individual  function 
selectively  and  that  an  individual's  development  is  a  critical 
learning  factor.     Bar-Tal  and  Bar-Zohar  (1977)  in  their  review  of 
36  studies  on  the  relationship  of  perception  of  control  and 
achievement  report  a  firm  trend  suggesting  that  for  persons 
attributing  failures  and  successes  to  self  achievement  was  higher* 

When  Baron  and  Ganz  (1972)  and  associates  (Baron,  Cowan,  Ganz  & 
MacDonald,   1972)  studied  various  feedback  strategies  using  academic 
achievement  as  a  dependent  variable,  significant  differences  were 
found  between  those  identified  as  attributing  the  consequences  of 
their  behavior  on  external  events  (Externals)  and  those  who 
accepted  the  responsibility  for  their  successes  and  failures 
(Internals).     It  is  suggested  that  by  early  adolescence  the  effect 
of  intrinsic  and  extrinsic  feedback  is  generally  governed  by 
variations  in  locus  of  control   (LOC).       Louie,  Luick  and  Louie 
(1985-86)  also  contend  that  these  perceptions  will  vary  from  person 
to  person  and  within  an  individual  over  time. 

Feedback  and  CAI 

More  recently  educational  research  has  attempted  to  determine 
the  effectiveness  of  the  microcomputer  used  in  the  instructional 
environment*  Some  researchers  (Tait  et  al,   1973;  Cohen,  1985; 
Albertson,   1988)  claim  instructional  design  of  CAI  generally 
inferior  as  reliance  is  placed  on  outmoded  theories  and  practice. 
Carrier  (1985)  emphasizes  that  educators  must  take  advantage  of  the 
microcomputer's  ability  to  collect  data,  respond  appropriately, 
diagnose  needs,  prescribe  instruction,   simulate  activities  and 
evaluate  sequences  among  other  characteristics  to  meet  individual 
learning  needs. 

The  study  of  feedback  strategies  in  instruction  by 
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nicroconputer  is  still  in  its  infancy.     In  one  study,  Cohen  (1985) 
discovered  that  the  greatest  effect  on  performance  resulted  from 
infornation  feedback  given  after  incorrect  responses.  Feedback 
after  correct  responses  was  reportedly  unimportant  to  students  in 
certain  cases.     Cohen  (1985)  posits  that  feedback  after  a  correct 
response  may  cause  interference  in  learning,   particularly  with 
those  students  who  maintain  high  confidence  in  their  knowledge  of 
the  material.     Immediate  feedback  seemed  most  effective  only  in 
knowledge  acquisition  for  those  students  having  difficulty 
mastering  the  material. 

In  a  later  study,  Waldrop,  Justen  and  Adams  (1986)  varied  the 
amount  of  corrective  feedback  during  drill  and  practice  in  CAI  and 
found  that  immediate  extended  feedback  following  both  correct  and 
incorrect  responses  is  superior  to  minimal  feedback  or  simply 
acknowledging  right  or  wrong  responses.     On  the  other  hand  delayed 
feedback  in  CAI  was  found  to  be  significantly  better  than  immediate 
feedback  in  a  study  by  Rankin  and  Trepper  (1978). 

Locus  of  control  and  CAI 

Cohen  (1985)  alludes  to  a  relationship  between  high  confidence 
in  the  knowledge  of  the  material  to  be  learned  and  the  need  for 
feedback.     Students  having  difficulty  mastering  the  material  seemed 
to  perform  better  given  immediate  feedback. 

Louie  et  al.   (1985-86)  studied  46  students,   9  to  15  years  of 
age,   of  high  socioeconomic  status  to  determine  whether  by  using 
Logo  and  Bank  Street  Writer  there  would  be  a  shift  in  LOC.  While 
the  results  are  questionable,   significant  shifts  were  found  in 
LOC.     In  a  study  by  Wesley  et  al.   (1985),  however,  no  main  effects 
and  no  interaction  of  LOC  and  acquisition  of  science  process  skills 
during  CAI. 

As  the  use  of  microcomputers  increases,  concepts  such  as 
reinforcement,   feedback  and  LOC  need  to  be  more  clearly  defined 
Louie  et  al.   (1985-86)  states  that  **if  locus  of  control  does  play  a 
significant  part  in  the  child's  interpretation  of  reinforcement  and 
its  relationship  to  events  occurring  in  reality,   then  software 
design  should  be  influenced  in  the  light  of  such  research  findings** 
(p. 107). 

The  need  for  feedback  in  CAI  studies  is  strongly  urged  by 
Gilman  (1969)  and  others  (Cohen,   1985;   Hedberg  and  McNamara,  ; 
Merrill,   1983,   1987).     Furthermore,  Merrill  (1987)  and  Cohen  (1985) 
express  the  need  for  better  and  more  efficient  CAI. 

The  new  technology  demands  that  developers  of  instruction 
integrate  current  research  findings  related  to  cognition  and 
instruction  (Costa,   1980)  into  instructional  design  of  CAI.  With 
the  high  potential  the  microcomputer  holds  as  a  teaching/learning 
tool  expanded  by  the  ease  of  current  assuring  systems,  the 
possibility  of  designing  diverse  instruction  to  meet  specific 
individual  needs  is  now  possible. 
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The  study 

Purpose 

This  study  was  designed  to  examine  the  effects  of  inmediatey 
delayed  and  no  feedback  conditions  on  recall  and  retention  in  a 
computer  based  instruct'^on  and  to  determine  whether  an  individual's 
LOG  significantly  interacts  to  affect  performance. 

It  was  hypothesized  that: 

1.  Given  immediate  feedback,   the  Externals  (learners 
identified  as  having  external  LOG)  will  perform  significantly 
better  than  the  Internals  (learners  identified  as  having  internal 
LOG)  on  the  tests  for  recall  and  retention. 

2.  Given  delayed  feedback,  the  Internals  will  perform 
significantly  better  than  Externals  on  the  tests  for  recall  and 
retention. 

3.  Given  no  fcedbacki   the  Internals  will  perform  significantly 
better  than  Externals  on  the  tests  for  recal 1  and  retention. 

4.  Significant  interaction  will  be  found  between  LOG  measures 
and  the  feedback  conditions. 

Location 

The  study  was  conducted  at  a  junior  high  school  in  a 
midwestern,  suburban  community  of  approximately  60,000.     The  school 
serves  a  middle  to  upper  middle  social-economic  population. 

Subjects 

Subjects  were  37  students  in  two  9th  grade  and  one  8th  grade 
Social  Studies  classes,   23  males  and  14  females. 

Microcomputers 

Twelve  Apple  II  and  lie  microcomputers  in  the  school's 
Microcomputer  lab  were  used  in  the  study.     The  arrangement  of  the 
equipment  permitted  students  to  work  independently. 

Questionnaire 

The  Intellectual  Achievement  Responsibility  Questionnaire 
(lARQ)  developed  by  Crandalli   Katkovsky  and  Grandall  (1965)  was 
used  to  measure  students'  beliefs  that  failures  and  successes  in 
achievement  are  caused  by  internal  or  external  factors.  The 
instrument  has  acceptable  reliability,  both  divergent  and 
convergent  validity  (MacDonald,  1973)  and  contains  34  forced-choice 
items.     A  total  of  24  or  less  identified  the  students  as  having 
external  LOG  and  26  or  morei  internal  LOG. 

Computer  assisted  instruction  (CAI) 

The  same  instructional  sequence  was  presented  under  three 
different  conditions:   immediatei  delayed  and  no  feedback.  The 
lessons  were  created  using  Super-Pilot ,  an  Apple  authoring  software 
package.     In  order  that  the  instruction  could  be  easily  completed 
during  one  50-minute  period,  each  program  consisted  of  28  frames 
taking  about  20  minutes. 

Immediate  feedback  condition 

The  GAI  program  presented  text  and  graphics.  At  the 
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end  of  each  step,   the  student  responded  to  a  question  relative 
to  the  infonoation,  was  given  praise/acknowledgioent  of 
correctness/incorrectness  of  answer,  was  remediated  if 
incorrect,  then  instructed  to  continue. 

Delayed  feedback  condition 

The  CAI  program  presented  identical  text  and 
graphics.     The  student  was  informed  in  the  introduction  to  the 
lesson  that  responses  to  questions  would  not  be  acknowledged  at 
the  end  of  each  step  but  would  be  delayed  until  the  end  of  the 
lesson.     Therefore,  at  the  end  of  each  step,  the  student 
responded  to  a  question  relative  to  the  information  but  was  not 
given  feedback  before  being  instructed  to  continue. 

No-feedback  condition 

The  CAI  program  presented  identical  text  and  graphics. 
The  student  was  informed  in  the  introduction  to  the  lesson  that 
responses  to  questions  would  not  be  acknowledged.     At  the  end 
of  each  step  the  student  was  given  the  option  to  respond  or  not 
respond  then  instructed  to  continue. 

Immediate  test  for  recall 

A  15-item  paper  and  pencil  test  was  given  immediately  after  the 
CAI  instruction. 

One  week  test  for  retention 

A  similar  15-item  paper  and  pencil  test  was  given  a  week  after 
the  CAI  instruction. 

Experimental  schedule 

The  lARQ  was  administered  one  week  prior  to  the  CAI  testing. 
Students  were  divided  into  two  LOC  groups  according  to  scores  on 
the  lARQ  with  Internals  scoring  26  and  above  and  Externals  scoring 
24  and  less  on  a  scale  from  1*34.     Each  LOC  group  was  further 
subdivided  into  three  treatment  groups,   IFB,  DFB  and  NFB. 

On  the  day  of  the  instruction,  students  received  individual 
lesson  diskettes  identified  by  previously  assigned  identification 
numbers  before  proceeding  to  the  microcomputers.     Since  there  was 
general  familiarity  with  the  use  of  the  equipment,  students  were 
asked  to  **boot**  the  program  by  simply  inserting  the  diskette  into 
the  disk  drive  and  turning  on  the  power  switch.  Bach  of  the 
programs  directed  the  students  to  raise  their  hands  upon  completion 
of  the  instruction  to  signify  readiness  for  the  test  for  recall. 

Once  the  test  was  completed,  the  students  returned  to  the 
classroom.     Two  days  following  the  instruction  each  student 
received  the  results  of  the  test  and  corrective  information  to 
those  items  missed  on  the  test.     Seven  days  following  the  initial 
test,  a  paper  and  pencil  test  for  retention  was  administered. 
Confidentiality  was  preserved  by  teacher  assigned  identification 
numbers . 
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Analysis  of  data 

Perforaance  scores  on  the  tests  for  recall  (Tl)  and  retention 
(T2)  and  locus  of  control ,   Internal  and  External ,  were  the 
dependent  neasiires.     The  treatment ,  consisting  of  of  innediate 
(IFB),  delayed  (DFB)  and  no-feedback  (NFB)  conditions,  was  the 
independent  measure.  t-*tests  were  performed  to  detect  the  presence 
of  significant  differences  between  the  means  of  the  treatment 
groups  for  the  Internal  and  External  measures.     The  2x3 
multivariate  analysis  of  variance  (NANOVA)  was  used  to  test  for 
interaction  between  LOG  and  feedback. 


Results 

The  summary  of  cell  means  and  standard  deviations  for  the 
variables  are  presented  in  Table  1.     The  test  for  recall  (Tl)  and 
retention  (T2)  were  scored  on  the  basis  of  number  of  correct 
answers  out  of  a  possible  maximum  of  15  items  for  each  test.  Locus 
of  control  was  determined  by  scores  on  the  lARQ  with  Internals 
scoring  26  and  more  and  Externals  scoring  24  and  less  on  a  scale 
from  1-34. 


Insert  Table  1  here 


Hypothesis  1.     Given  immediate  feedback,   the  Externals  will 
perform  significantly  better  than  Internals  on  tests  for  recall  and 
retention  during  CAI. 

The  t-test  used  to  compare  the  means  of  performance  scores  of 
the  IFB  condition  on  the  Internals  and  Externals  indicated  no 
significant  difference  on  Tl,   t(li)=-0.11,   or  T2,  t(8)=-0.71. 


Insert  Table  2  here 


Hypothesis  2.     Given  delayed  feedback,   the  Internals  will 
perform  significantly  better  than  Externals  on  tests  for  recall  and 
retention  during  CAI. 

The  t-tests  used  to  compare  the  means  of  performance  scores  of 
the  DFB  condition  on  the  Internals  and  Externals  indicated  a 
significant  difference  in  performance  for  Tl,   t(12)=1.90,  p<.04. 
No  significant  difference  was  noted  in  T2,   t(12)=1.56  (Table  2) 

Hypothesis  3.     Given  no  feedback,   the  Internals  will  perform 
significantly  better  than  the  Externals  on  tests  for  recall  and 
retention. 

The  t-test  used  to  compare  the  means  of  performance  scores  of 
the  NFB  condition  on  the  Internals  and  Externals  indicated  no 
significant  difference  on  Tl,   t(ll)=0.08,   or  on  T2,  t(ll)=-1.64 
(Table  2). 
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Hypothesis  4>     Significant  interaction  will  be  found  between 
LOG  measures  and  feedback  conditions* 

Neither  the  test  on  the  univariate  (Table  3)  nor  the  NANOVA 
using  Wilkes  test  of  significance  (Table  4)  indicates  the  presence 
of  any  interaction  between  LOG  and  feedback  conditions* 


Discussion 

The  results  of  the  t-tests  performed  on  the  treatment  variables 
provide  no  support  of  the  hypotheses  that  IFB  or  NFB  during  GAI  of 
factual  information  are  more  effective  conditions  for  recall  and 
retention^  or  that  they  are  better  instructional  conditions  for 
either  Internal  or  External  LOG  learners.     However,  the  significant 
difference  found  between  the  performance  of  Internals  and  Externals 
under  DFB  conditions  (p-<«04)   indicates  LOG  learners  would  be  more 
likely  to  show  better  performance  under  DFB  conditions  than  from 
either  IFB  or  NFB  conditions. 

In  earlier  LOG  by  academic  achievement  studies,  Grandall  and 
Battle  (1970),  Baron  and  Ganz  (1974)  and  Bar-Tal  and  Bal-Zohar 
(1977),  have  found  that  high  achievers  are  generally  Internals.  In 
addition  feedback  studies  show  delayed  feedback  to  be  more 
effective  for  certain  individuals  (Kulhavy,  1977;  Rankin  &  Trepper, 
1978). 

If,   indeed,  the  data  support  the  hypothesis  that  given  DFB 
Internals  will  perform  better  than  Externals,   it  could  provide  some 
insight  into  the  type  of  individual  who  benefits  from  DFB. 
Kulhavy^ 8  (1977)   "interference  due  to  error  perseveration** 
phenomenon  (p.  223)  could  bet  indicative  of  a  characteristic  of  the 
cognitive  process  experienced  by  the  Internal. 

Drawing  conclusions  regarding  achievement  and  locus  of  control 
during  GAI  from  this  study  or  any  study  must  be  done  cautiously 
(Stipek,   1980),  however.     It  is  the  contention  of  researchers  that 
in  addition  to  flaws  in  research  design  and  procedure  there  are 
other  variables  such  as  socioeconomic  conditions  (Grandall, 
Katkovsky  fc  Grandall,   1965),  race  (Baron  et  al.,   1974),  and  sex 
(Louie  et  al.,   1985-86)  which  operate  to  confound  any  set  of  data. 

While  comparable  results  are  described  in  other  studies  in 
feedback  conditions  in  instruction  and  the  effect  of  locus  of 
control  in  academic  achievement  (Beck  fc  Lindsey,   1979;  Kulhavy, 
White,  Topp,  Ghan  &  Adams,   1985;  Bar-Tal  &  Bar  Zohar,   1977)  major 
limitations  contributed  to  the  contamination  of  the  present  study. 

1*     Small  sample  size 

A  larger  sample  would  indeed  have  increased  the  power  of 
the  study.     Keppel  (1982)  suggests  that  a  2x3  factorial  design  have 
at  least  20  subjects  per  cell.     Although  contact  was  made  with  79 
students  in  this  study,  only  37  completed  all  phases  of  the  study. 
Absences  and  inattentiveness  were  primary  causes  of  attrition. 
2.     Limited  instructional  time 

Permission  to  conduct  the  study  in  a  junior  high  school 
classroom  was  obtained  contingent  upon  an  agreement  that  the  lARQ, 
the  lesson,  and  tests  for  recall  and  retention  take  no  longer  than 
70  minutes  on  three  given  days,   10  minutes  for  the  lARQ,  50  minutes 
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for  instruction  and  10  minutes  for  the  retention  test.  Instruction 
over  a  longer  period  of  time  would  have  produced  more  significant 
data. 

3.  Short  CAI  program 

In  order  that  the  students  spend  no  more  than  50  minutes  in 
the  microcomputer  lab,  it  was  necessary  to  limit  the  CAI  program  to 
28  frames  which  took  approximately  20  minutes  for  the  students  to 
complete.     The  narrow  range  of  performance  values  did  not  provide 
an  accurate  profile  of  knowledge  acquisition  or  retention* 

4.  Instruction  not  a  part  of  the  classroom  curriculum 

The  awareness  that  the  lesson  would  not  affect  students' 
grades  appeared  to  have  impact  on  attitude  toward  the  instruction. 
Obvious  signs  of  relief  were  observed  when  students  were  told  the 
tests  would  not  be  graded. 


Conclusions 

In  spite  of  the  four  limitations  cited,  two  conclusions  are 
made.     The  first  relates  to  the  hypotheses  and  the  second  to 
experimental  design. 

The  data  indicates  a  need  for  further  research  on  the 
effectiveness  of  delayed  feedback  for  internal  LOC  learners  during 
CAI.     Out  of  the  four  hypotheses  presented,  the  results  showed 
support  only  for  the  delayed  feedback  as  an  effective  condition  for 
learners  who  are  identified  as  Internals. 

From  this  study  it  is  concluded  that  in  conducting  research  of 
this  nature,  it  would  be  valuable  for  researchers  to  be  aware  of 
the  processes  involved  in  obtaining  data  from  school  children  and 
the  yield  from  such  studies.     It  should  be  noted  that  seven  levels 
of  approval  had  to  be  met  before  experimentation  could  begin  and 
that  the  attrition  rate  was  53%  which  yielded  37  usable  data. 
Information  of  this  soit  is  Just  as  necessary  in  interpreting  the 
results  of  studies  such  as  this  as  are  statistical  data. 
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Table  1 

SuBunary  of  cell  means  and  standard  deviations  of  Inioediate 
(IFB)t  Delayed  (DFB)  and  No-feedback  (NFB)  treatment  groups  on 
LOC  groups  ' 


T8ST  fUK 

my#v  ATT 
RKCALL 

(Tl) 

LOC 

Treatat 

Mean 

S.D. 

N 

95X  Conf. 

Interval 

Internal 

IPB 

12.714 

2.360 

7 

10.531 

14.897 

DFB 

13.556 

1.424 

9 

12.461 

14.650 

NFB 

12.429 

2.070 

7 

10.514 

14.343 

External 

• 

IFB 

12.667 

1.528 

3 

8.872 

16.416 

DFB 

11.200 

3.271 

5 

7.138 

15.262 

NFB 

12.333 

2.503 

6 

9.706 

14.960 

Bntire 

Sample 

12.595 

2.192 

37 

11.864 

13.325 

TEST  FOR  RBTENTION  (T2)  

LOC      Treatat      Mean  S.D.  N  95>  Conf.  Interval 


Internal 

IFB 

8.429 

2.225 

6.370 

10.487 

DFB 

10.667 

1.581 

9 

9.451 

11.882 

NFB 

7.857 

1.676 

7 

6.307 

9.407 

External 

IFB 

9.667 

3.215 

3 

1.681 

17.652 

DFB 

9.000 

2.449 

5 

5.959 

12.041 

NFB 

9.833 

2.639 

6 

7.063 

12.603 

Bntire 

Sanple 

9.270 

2.269 

37 

8.514 

10.027 
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Table  2 

Sunnary  of  cell  neans,  standard  deviations  and  fc-test  of  IFB,  DFB 
and  NFB  on  Internal  and  External  LOG 

TEST  FOR  RECALL  (Tl) 


iMediate 


LOG 

N 

Mean 

S.D. 

t-Value 

df 

Internal 

7 

12.714 

2.360 

-0.11 

11 

External 

3 

12.667 

1.528 

Total 

10 

12.700 

Mean  Difference 

0.047 

Delayed 

LOG 

N 

Mean 

S.D. 

t-Value 

df 

Internal 

9 

13.556 

1.424 

-1.90* 

12 

External 

5 

11.200 

3.271 

Total 

14 

12.715 

Mean  Difference 

2.356 

*  p=<.04 

No-feedback 

LOG 

N 

Mean 

S.D. 

t-Value 

df 

Internal 

7 

12.429 

2.070 

0.08 

11 

External 

6 

12.333 

2.503 

Total 

13 

12.384 

Mean  Difference 

0.096 

Q  536 

ERIC 

532 


15 


TBST  FOR  RBTBNTION  (T2) 
Inedlate 


LOG 

N 

Mean 

S.D. 

t-Value 

df 

Internal 

7 

8.429 

2.225 

-0.71 

8 

External 

3 

9.667 

3.215 

Total 

10 

8.800 

Mean  Difference 

1.238 

Delayed 

LOG 

N 

Mean 

S.D. 

t-Value 

df 

Internal 

9 

10c667 

1.581 

1.56 

12 

External 

5 

9.000 

2.419 

Total 

14 

10.072 

Mean  Difference 

1.6P 

No- Feedback 

LOG 

N 

Mean 

S.D. 

t-Value 

df 

Internal 

7 

7.857 

1.676 

-1.64 

11 

External 

6 

9.833 

2.839 

Total 

13 

8.769 

Mean  Diffei jnce 

1.976 
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Table  3 

Test  of  significance  of  interaction  between  Internal  and  External 
LOG  and  treataent  conditions  on  the  univariate 

TSST  FOR  RBCALL  (Tl) 

Factor  df  SS  MS  ^  F  Sigaif.  of  F 

LOG  1  5.691  5.691         1.144  .293 

Treataent  2  .613  .307  .062  .9^0 

LOG  X  Treatment    2  10.418         5.209        1.047  .36'i 


TEST  FOR  RETENTION  (T2>  . 

Factor  df  SS  MS  F  Siitnif.  of  F 

LOG  1  2.184  2.184  .463  .501 

Treatment  2  6.827  3.413  .724  .493 

LOG  X  Treataent    2  23.225  11.612        2.454  .102 
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Table  4 

Wilkes  multivariate  test  of  significance  for  LOG,  Treatment  and  LOG 
X  Treatment 

Factor  Value  df  F  Signify  of  F  

LOG                          .889  2              1.873  .171 

Treatment               .920  4               .637  .645 

LOG  X  Treatment     .859  4             1.181  .328 
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Abstract 


R  siiulatlon  is  described  in  terfts  of  its  three  lajor  design 
aspects:  the  scenarioj  the  underlying  lodelj  and  the  instructional 
ouerlay.    The  aajor  focus  of  this  paper  is  on  the  instructional 
oueriay  which  serves  to  optiiize  learning  and  motivation.  The 
functions  of  sinutations  and  the  features  that  should  be  used  to 
achieue  these  functions  are  described.    Prescriptions  for  the  design 
of  cotputer*based  siiftulat ions  are  presented  in  the  fori  of  a  general 
ttodel  and  variations  on  the  general  aodel.    The  general  aodel  offers 
prescriptions  for  the  design  of  the  introduct ion^  acquisitionj 
applicationj  and  assesssent  stages  of  siiulations  and  for  dealing 
•  ith  the  issue  of  control  (system  or  learner).    Uar tat  ions  on  the 
general  node!  are  based  on  the  nature  of  the  behavior  (procedures^ 
process  principtesj  and  causal  principles)j  conpiexity  of  the 
content^  for*  of  learner  participationj  fom  of  changes  (physical  or 
non*physicai}j  and  notivat ional  requirenents. 
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Introduction 


The  aduent  of  the  coi&putep  has  tade  possible  a  neoi  and 
exciting  fori  of  learning  enuironnent^  the  sinulation.    lie  now  haue 
the  technology  for  a  powerful  fori  of  instruction  that  is  both 
dynaaic  and  Interact iue  and  that  can  prouide  considerable  variety 
vithin  a  sinuiated  enuironnent.    Euen  a  personal  tutor  is  incapable 
of  such  uersatiiity.    Conputer-based  siiulations  can  prouide 
efficient  J  effect iuej  and  highly  lotiuational  instruction  that  can 
readily  serue  the  need  for  indiuidual izat ion.    Siiulations  also 
enhance  the  transfer  of  learning  by  teaching  coip lex  tasks  in  an 
enuironaent  that  approxiaates  the  real  vorld  setting  in  soae 
iaportant  aays. 

Ho»  effectiue  a  siaulation  is  in  doing  this  vill  be  determined 
by  three  aajor  aspects  of  its  design:  the  scenario^  the  underlying 
aodeij  and  the  instructional  oueriay.  The  scenario  of  a  siaulation 
recreates  to  a  greater  or  lesser  degree  a  real  life  situation.  It 
deteraines  what  wiil  happen  and  how  it  will  take  piace,  who  the 
characters  ore  and  what  objects  are  inuoluedj  as  well  as  the 
learner's  role  and  how  he  or  she  will  interface  with  the  siaulation. 
To  siauiate  a  situation^  the  coaputer  aust  respond  to  learner 
actions  in  a  way  that  reflects  that  situation.    This  requires  a 
Bodeli  usually  a  aatheaatical  forauia  deterained  by  an  expert^ 
which  reflects  the  causal  relationships  that  gouern  the  situation. 
Final ly,  the  siaulation  should  haue  an  instructional  oueriay  to 
optiaize  learning  and  aotiuation. 

This  paper  focuses   n  prescriptions  for  designing  the 
instructional  oueriay^  for  our  analysis  of  siaulations  has  revealed 
that  this  is  by  far  the  weakest  of  the  three  aspects  of  simulation 
design  in  educational  siaulations  that  haue  been  created  to  date. 
However,  a  brief  coaaent  about  the  other  two  aspects  is  in  order. 

The  scenario  and  underlying  aodel  should  reflect,  to  soae 
degree,  the  situation  being  siaulated.    But  to  what  degree?  Should 
we  always  atteapt  to  create  aaxiaua  fidelity,  or  is  it  soaetiaes 
aore  effective  to  alter  or  siaplify  reality?     RIessi  (1987) 
suggests  that  aaxiaua  fidelity  does  not  necessarily  prouide  the  aost 
effect iue  instruction.    Ue  propose  that  certain  aspects  of  the  real 
world  situation  should  be  represented  with  high  fidelity  in  the 
siaulation,  while  soae  need  not,  and  soae  should  not.    Ue  suspect 
that  the  ''fundaaentals''  of  the  real  situation  should  have  high 
fidelity:  those  basics  which  deteraine  the  nature  of  the  aental  and 
in  soae  cases  physical  actiuities  required  of  the  learner  in  the 
real  situation.     Oore  superficial  aspects  of  the  real  siturjtion  are 
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less  likely  to  ittproue  transfer  to  the  real  situation  when  designed 
into  a  simulation  and  lay  in  fact  create  ouerloadj    which  impedes 
learning  and  sotiuation.    Ue  suggest  that  four  factors  should  be 
considered  in  all  decisions  about  fidelity  of  the  scenario  and 
aodei: 

•  Ouerioad  -  the  degree  to  which  superficial  details  or 
cofliplexilies  of  the  real  situation  obscure  the  content  to  be 
learned. 

•  Transfer  -  the  ability  to  use  what  has  been  learned  in  the 
real  situat ion(s). 

•  Affect  -  the  sotiuatlonal  appeal  of  the  simulation. 

•  Cost  -  design J  deuelopientj  and  production  cost  of  the 
simulat  ion. 

Ouerlpad  and  cost  generally  argue  against  fidelity  for 
superficial  aspects  of  the  real  situat ionj  whereas  transfer  and 
affect  generally  argue  for  it.    Often  the  best  design  is  one  which 
begins  with  low  fidelity  and  progresses  by  leuels  to  high  fidelity 
at  the  end  of  the  instruction. 

The  remainder  of  this  paper  addresses  the  third  aspect  of 
simulationsj  the  instructional  ouerlayj  wliich  includes  ail  the 
instructional  design  features  of  a  simulation  and  how  they  should  be 
used  to  optimize  instruction. 

Instructional  Ouerlay 

Despite  the  existence  of  a  considerable  number  and  uariety  of 
simuiationsi  a  literature  reu lew  for  the  instructional  ouerlayj  has 
repealed  that  few  general izable  prescriptions  haue  been  offered  to 
guide  the  design  of  Instructional  simulations.    Host  simulations 
haue  been  produced  using  a  "seat  of  the  pants"  approach.    Some  are 
quite  good;  manr  are  nothing  more  than  uideo-type  games  or  drill- 
and-practice  exe^'cises.    Almost  none  prouide  a  complete 
instructional  package.    In  our  attempt  to  formulate  an  instructional 
model  for  the  design  of  computer  based  simulationsj  we  haue 
addressed  the  following  questions: 

•  Uhat  are  the  different  kinds  of  simulations? 

•  Uhen  should  each  kind  of  simulation  be  used? 

•  Uhat  characteristics  should  each  kind  of  simulation  haue  to 
prouide  optimal  instruction? 

Ue  haue  conducted  a  suruey  of  the  literature  ond  analyzed  a  uariety 
of  simulations  to  prouide  answers  to  these  questions. 

The  dynamic  and  interact iue  nature  of  computer-based 
simulations  prouides  an  ideal  medium  for  teaching  students  content 
that  inuoiues  changes.    Such  content  includes  what  Herri  11  (19S3) 
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refers  to  as  principles  and  procedures  and  Gagne  (1985)  refers  to  as 
rulesi  Q  subcategory  of  his  intellectual  skills.     Uhile  simulations 
nay  also  be  usad  to  teach  facts  and  conceptSj  the  nature  of  this 
type  of  siftuiotion  oould  be  uery  different.    Our  theory  has  been 
deueloped  only  for  sinulations  that  teach  principles  and  procedures. 

In  our  analysis  cf  siiulations  and  literature  about 
siiulationsj  «e  houe  found  that  the  the  nature  of  the  content  or 
behauior  being  taught  is  the  aajor  influence  on  the  features  a 
simulation  should  haue.    For  examplei  aastery  of  nany  procedures 
such  as  long  diuision  and  writing  a  good  paragraph j  is  gradually 
acquired  ouer  tine,    but  for  tost  principlesj  ftostery  is  an 
In^tantaneousj  al 1-or-nothingj  flash  of  insight  or  understanding. 
Clear lyj  methods  of  instruction  mcst  be  very  different  for  each  of 
these  tvo  kinds  of  learning^  and  the  design  of  a  simulation  mill 
need  to  be  uery  different  for  each.    In  factj  we  have  identified 
three  major  types  of  simulations:  those  that  teach  proceduresj  those 
that  teach  process  principlesi  and  those  that  teav:h  causal 
principles. 

Uhat  4ie  haue  defined  qs  procedural  simulations  include  both 
the  physical  and  procedural  categories  described  by  Blessi  and 
Trollip  (1985).    Procedural  simulations  teach  the  learner  to  perform 
a  sequence  of  steps  and/or  decisionSj  as  in  flying  an  airplane  or 
adieng  fractions.     R  process  simulation  teaches  naturally 
occur ing  phenomena  composed  of  a  specific  sequence  of  events. 
Unlike  procedures,  processes  are  not  purposiuely  performed  by 
people,  but  are  naturally  occur ingj  as  is  the  action  of  a  volcano  or 
the  process  of  photosynthesis.      R  causal  simulation  teaches  the 
cause-effect  relationship  between  toio  or  more  changesj  for  exainpiej 
the  law  of  supply  and  demand  and  the  theory  of  natural  selection. 

Possible  Functions  of  Simulations 

It  is  useful  to  think  in  terms  of  three  phases  in  the  learning 
process  that  should  be  activated  by  educational  simulationSi  unless 
other  media  of  instruction  do  so.    The  learner  must  first  acquire  a 
basic  knowledge  of  the  content  or  behavior.    Then  he  or  she  must 
learn  to  apply  this  knowledge  to  the  full  range  of  relevant  cases 
or  situations.    The  final  stage  is  an  assessment j  in  some  cases  a 
self-assessment  J  of  what  the  learner  has  learned.    Thereforej  the 
first  set  of  instructional  strategies  in  a  general  model  for 
simulations  should  be  concerned  with  acquisition  of  the  content, 
the  second  set  with  application  of  the  content j  and  the  third  with 
assessment  of  learning. 
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The  first  functionj  acquisitlonj  is  to  teach    .e  content, 
which  In  our  case  Is  either  principles  or  procedures.  For 
principles  the  learner  must  acquire  a  aeanlng^ul  understanding  of 
the  natural  processes  or  cause-effect  relationships.    For  procedures 
the  learner  nust  acquire  knowledge  of  iihat  steps  to  follow  and  how 
arid  when  to  do  each  step, 

Rfter  the  learner  has  achieved  acquisitionj  he  or  she  must 
then  learn  to  apply  this  knowledge.     For  both  procedures  and 
principles  generol  izat  ion  is  required.  For  examplej  the  learner 
must  deuelop  the  ability  to  apply  the  steps  of  a  procedure  to  the 
full  range  of  inputs  and  conditions  that  iDoy  exist,    tlastering  a 
procedure  often  requires' outoaat  izat  ion  as  well  as  generalization. 
The  learner  must  develop  the  ability  to  perfori  the  sequence  of 
steps  and/or  decisions  alnost  without  thinking.    This  is  generally 
achieued  through  repetitive  practice.    Rpplication  of  causal 
principles  requires  utilization  |n  addition  to  generalization.  R 
perforaance  routine  that  gouerns  the  application  of  the  causal 
principle  nust  be  learned  or  inuented  by  the  learner.  Utilization 
refers  to  the  ability  to  use  the  appropriate  performance  routine  in 
order  to  apply  the  principle. 

The  assessment  function  of  the  simulation  determines  if  the 
learner  has  achieved  mastery,    tlastery  is  a  specified  criterion  for 
the  number  of  correct  responses  and/or  speed  of  response  on  a  set  of 
divergent  and  difficultj  previously  unencounteredj  practice  items. 

It  is  not  always  necessary  for  all  three  of  these 
instructional  functions  to  be  served  by  a  simulationj  for  any  one  or 
two  of  these  functions  can  be  accomplished  outside  of  the 
simulation.    However^  often  no  provision  is  made  for  a  function  to 
be  accomplished  if  it  is  not  specifically  included  in  the 
simulation,    find  there  is  usually  no  valid  reason  for  not  including 
all  three  within  the  simulation. 

Features  of  Siiulations 

Based  on  instructional  theory  and  an  examination  of  many 
simulationsj  we  have  identified  five  simulation  features  that  act  as 
vehicles  for  achieving  acquisitionj  applicationj  and  assessment. 
These  include  the  general ity^  example^  practice^  feedback j  and  help. 
These  basic  features  of  simulations  correspond  to  the  presentation 
forms  of  Herri  I Ts  (1983)  Component  Display  Theory  and  four  of 
Gagne's  (1985)  events  of  instruction  (present  the  stimulus,  elicit  a 
responssj  provide  feedback  and  provide  learner  guidance). 
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The  generality  is  a  statement  of  the  relationship  among 
changes  that  characterizes  a  procedure  or  principle.    It  may  take 
the  form  of  a  uerbal  presentation!  for  examplej  a  statement  of  the 
laoi  of  supply  and  demandj  or  it  may  be  a  uisual  representat ion^  such 
as  a  set  of  graphs  showing  the  relationship  between  supply  and  price 
and  between  demand  and  price. 

Rn  example  is  a  specific  instance  or  case  that  shows  the 
relationship  among  changes  described  in  the  generality.    It  may  be 
presented  as  a  deionstrat ion  with  no  actiue  learner  participation 
or  as  an  exploration  in  which  the  learner  manipulates  the  example 
to  see  what  happens.    The  nature  of  this  type  of  lea.^ner 
participation  is  different  from  that  required  for  application  of  the 
generality  in  that  the  learner's  behauior  is  not  that  specified  by 
the  object iue. 

Proctice  provides  the  learner  with  the  opportunity  to  apply  a 
generality  to  diuerse  instances  with  the  required  proficiency. 
Practice  consists  of  two  components:  a  stiiulus  situation  presented 
by  the  simulation  and  a  learner  response  that  is  consistent  with 
the  instructional  object iues. 

Feedbock  prouides  the  learner  with  confirmatory  or  correct! Me 
information  regarding  his  or  her  responses.    Rllessi  and  Trollip 
(1985)  note  that  there  are  two  forms  of  feedback^  natural  and 
artificial.    Natural  feedback  is  a  real-life  consequence  of  a 
response;  artificial  feedback  is  a  contriued  consequence  which 
would  not  occur  in  the  real  situation.    In  the  '^Flight  Simulator"^ 
dials  showing  altitude  and  fuel  leuel  are  forms  of  natural  feedback^ 
as  well  as  the  ulew  through  the  cockpit  window. 

Natural  feedback  may  be  sufficient  for  simple  tasks  but  may 
not  prouide  enough  information  for  complex  tasks  that  require  a 
chain  of  responses  before  the  natural  consequences  manifest 
themselues.    In  such  cases  artificial  feedback  may  be  used  to 
prouide  the  learner  with  additional  assistance  and  may  be  either 
informational  or  ■otiuational  in  nature.    R  statement  in  a 
flight  simulation  that  tells  the  learner  to  check  his  fuel  gauge  is 
Informational  feedback  because  it  prouides  additional  information 
that  would  not  occur  in  the  real  situation.  Phrases  such  as^  ''Keep 
up  the  good  work!"  or  "Try  again^  you  can  do  it!"  prouide  praise  or 
encouragement  to  the  learner  and  so  are  motiuationa!  types  of 
artificial  feedback. 

Help  prouides  the  learner  with  direction  and  assistance 
during  the  presentation  of  the  general ity^  examples^  practice  and 
feedback.  The  difficulty  of  the  content  and  the  instructional 
opprocich  (expository  or  discouery)  will  determine  what  type  and  how 
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much  help  i3  needed.    Ue,  haue  distinguished  three  different  types  of 
help  based  on  function.  The  first  directs  attention  using 
flashingj  colori  boldj  arrcwsj  labelsj  etc.  to  ei&phasize  iiiiportant 
aspects  of  the  presentation.    The  second  relates  the  instance 
(exQiDpie  or  practice  case)  to  the  generality  by  providing 
commentary.    The  third  type  facilitates  encoding  by  providing  a  . 
second  representat ionj  for  example  a  diagram^  along  «ith  a 
definition.     This  tends  to  increase  the  depth  of  processing  and 
enhance  understanding  and  retention. 

Rnother  feature  of  simulations  is  the  representation  foPBi 
the  uiay  in  which  material  is  displayed  on  the  screen.    Ue  hage 
adapted  Bruner's  (I960)  classification  to  characterize  four 
representation  forms:  enact ivej  iconicj  visual  symbolic^  and  verbal 
symbolic.    The  enact ive  form  uses  a  3  dimensional  unit  along  »ith 
the  computer  to  provide  the  most  realistic  simulations.    Rn  iconic 
formj  the  second  most  realistic^  consists  of  video  or  graphic 
displays.    Less  realistic  but  very  effective  for  simplifying 
difficult  content;  uisuai  symbolic  uses  symbols  or  iconsj  and 
uerbal  symbolic  is  composed  of  letters  and  numerals. 

Rll  four  representation  forms  may  be  used  to  produce  a  dynamic 
presentation  that  requires  learner  part icipat ion^  but  the  degree  of 
realism  oil!  differ  depending  on  the  nature  of  the  content  and  the 
instructional  objectives.    Rs  was  discussed  above  regarding  the 
fidelity  of  the  scenarioi  the  simulation  can  often  be  most  effective 
by  simplifying  to  eliminate  distracting  and  unimportant  aspects  of 
the  real  situation  or  by  altering  the  speed  of  a  process  to  reveal 
what  is  not  normally  evident,    in  other  situations  the  closest 
approximation  of  reality  may  be  desirable  to  enhance  learning 
transfer. 

Figure  1  presents  a  summary  of  the  available  features  that 
can  be  used  to  achieve  the  functions  of  simulations.  During 
acquisitioni  if  the  learner  is  not  required  to  figure  out  the 
general ity^  an  expository  approach  is  being  used  and  the  learner 
should  be  presented  with  the  generality  and  a  prototypical  example. 
Rppiication  with  no  performance  of  the  criterion  behavior  is  an 
example.    Uhen  learner  participation  is  utiiizedj  the  approach  and 
features  are  different.    In  the  case  of  acquisitionj  if  an  example 
is  presented  and  the  learner  required  to  "figure  out"  the 
general ity^  a  discouery  approach  is  being  used.    Rppiication  that 
involves  performance  of  the  criterion  behavior  is  practice  and 
should  be  accompanied  by  feedback.    It  is  important  to  note  that  the 
two  types  of  examples^  observation  and  exploration^  also  differ 
based  on  learner  participation  or  lack  thereof.    Unlike  an  example 
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that  13  purely  obseruationai^  an  exploration  type  exaoiple  can  be 
manipulated  by  the  learner  through  the  keyboard  or  eone  other  input 
deuice.     The  general  instruct iona!  model  and  uariationd  that  follooi 
prescribe  the  optimum  features  and  approach  for  each  kind  of 
simulat  ion. 


Insert  Figure  1  about  here 


R  General  Rode  I  for  Simulations 

The  theory  me  haue  constructed  originates  with  the  three 
phases  of  learning  described  aboue.     ile  haue  organized  and  adapted 
the  features  of  simulations  to  provide  the  learner  lith  the  most 
effective  and  efficient  presentations  In  order  to  achieue  successful 
acquisition^  application  and  assessment.    Our  general  model 
describes  fiue  aspects  of  simulations  and  provides  prescriptions  for 
the  implementation  of  each.    It  applies  to  oil  simulations  for 
teaching  principles  or  procedures.    Specific  conditions  or  types  of 
simulations  require  their  ovn  characteristic  prescriptions  that  are 
described  as  variations  on  the  general  model. 

Before  proceeding  with  the  "how  to"  of  simulation  design,  some 
consideration  should  be  given  to  the  question  of  "when  to"  use 
simulations.  Ue  believe  that  simulations  are  an  extremely  efficient 
and  effective  forr  of  instruction  for  content  involving  changes  and 
therefore  should  be  used  to  teach  principles  and  procedures  u/henever 
the  audience  is  targe  enough  for  computer-based  simulations  to  be 
cost  effective. 

Select  the  Rppropriate  Complexity 

The  design  of  the  instructional  overlay  for  any  simulation 
begins  with  selection  of  the  appropriate  complexity  for  the  content 
or  behavior  that  is  to  be  learned.    The  real  situation  is  usually 
quite  complexi  with  many  variables  to  consider  for  successful 
performance.     To  begin  with  so  many  variables  in  the  underlying 
model  will  clearly  impede  learning  and  motivation.    The  best  design 
is  usually  one  which  begins  with  only  one  or  two  variables  in  the 
model  and  progresses  by  levels  to  include  all  Important  variables  at 
the  end  of  the  Instruction.    This  is  a  matter  of  "instructional 
overlay"  being  superimposed  on  the  model. 

•  First  determine  the  complexity  of  the  most  realistic 
underlying  model  you  will  use. 
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•  If  it  13  coiprised  of  only  q  few  Mariobles^  select  an 
integral  approach;  that  iSj  do  not  break  it  douin  into 
dUpler  leuels* 

•  pthervise  plan  on  simplifying  the  iRodel  using  one  of  the 
approaches  described  under  "Uariations  on  the  General  nodeT 
below* 

Introduct  ion 

The  siiulation  begins  with  an  introduction  that  describes  the 
scenarioj  identifies  gooU  and  object iueSi  and  presents  directions 
and  rules  that  will  gouern  the  sinulation* 

•  Set  the  stage  in  the  scenorio  presentation  by  describing 
the  setting^  the  fort  of  learner  participation!  and  the 
Bajor  characters  or  objects*    Describe  how  the  simulation 
will  proceedj  what  will  happen^  and  under  what 
circuistances* 

•  Present  the  goals  and  objectiues  wheneuer  possible  as  part 
of  the  scenario  to  proi^ide  o  concrete  exanple  and  to  enhance 
ieaningfui  understanding  and  lotiuational  appeaL 

•  Use  directions  and  rules  to  describe  how  to  use  the 
prograWj  including  such  things  as  key  functionsj  use  of 
learner  controlj  and  other  options.    Present  directions  as 
text  with  graphic  or  uideo  support  that  requires  ftinimal 
dependence  on  docunentat ion.    Present  rules  as  a 
dewonstration  within  the  scenario  wheneuer  possible. 

Acquisition 

During  the  acquisition  stage  the  learner  deuetops  a  ineaningful 
understanding  of  a  principle  or  knowledge  of  the  steps  in  a 
procedure.    The  acquisition  function  nay  be  achieved  by,  means  of  an 
expository  or  a  discovery  approach  and  way  require  either 
exploration  or  observation  by  the  learner.    In  an  expository 
approach  the  generality  is  presented;  in  g  discouery  approach  the 
learner  Is  required  to  "figure-out"  the  generality.  The  preferred 
approach  and  fori  of  learner  participation  depends  on  the  nature  of 
the  content  and  criterion  behavior  and  is  discussed  later  under 
"Uarlations." 

•  if  an  expository  approach  is  usedj  provide  the  generality 
along  with  a  prototypical  exawple  for  the  learner  to  explore 
or  observe  (see  "Uariatlons").    The  order  of  the  generality 
and  exaipie  way  be  varied  to  create  either  an  inductive  or 
deductive  expository  approach   (see  "Uariations"  below). 
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•  For  a  discouery  approach,  require  the  learner  to  "figure- 
out"  the  generality  by  exploring  or  observing  a  prototypical 
exaipie.   Prouide  help  In  the  fort  of  hints  and  prospts  to 
assist  the  learner  «ith  the  discouery  process. 

•  Prouide  help  to  direct  attention,  relate  the  generality  to 
the  exanple,  or  facilitate  encoding  by  presenting  a  second 
representation  as  needed  during  acquisition.    Use  tore  help 
and  use  it  tore  frequently  depending  on  the  difficulty  of 
the  content  in  relation  to  learner  ability  and  experience. 

flpp Meat  ion 

During  the  application  stage  the  learner  develops  the  ability 
to  use  the  principles  or  procedures  that  have  been  introduced  In  the 
acquisition  stage.    The  prlaary  element  of  the  application  stage  is 
divergent  practice  coiposed  of  a  stiaulus,  a  learner  response,  help, 
and  feedback. 

•  Provide  cases  which  have  a  variety  of  stiiulus  conditions 
that  include  the  full  range  of  divergence  existing  in  the 
real  world. 

•  It  nay  be  necessary  to  create  o  ■echanisa  for  randonly 
producing  cases  that  include  all  possible  varieties  of 
stiaulus  conditions. 

•  Use  an  easy-to-hard  progression  of  difficulty  for 
presentation  of  cases. 

•  If  different  levels  of  difficulty  are  used,  require  the 
learner  to  reach  criterion  on  one  levsl  before  going  on  to 
the  next  level. 

•  Use  a  representation  fora  as  close  as  possible  to  that  or 
the  real  world  situation  unless  soae  fora  of  sinpl i f icat Ion 
In  teras  of  tiae  span  or  ccaplexity  Is  helpful  or  required 

.  by  cost  considerations. 

•  Provide  pre-response  ^  'p    (proapts  and  hints)  when  the 
difficulty  of  the  task  i^akes  it  necessary  to  direct 
attention  or  relate  the  practice  itea  to  the  generality. 
This  fora  of  help  should  fade  as  practice  progesses. 

•  Require  a  learner  response  consistent  with  the  terainul 
objectives  (criterion  behavior)  for  the  content. 

Bn  essential  coaponent  of  practice  Is  the  feedback  which 
follows  the  learner  response.    The  following  prescriptions  prouide 
guidance  for  the  design  of  effective  feedback. 

•  Use  natural  feedback  to  auxlaize  the  reality  of  the 
siaulation.    The  underlying  aode)  (discussed  earlier)  should 
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produce  the  apropriole  natural  feedback  for  the  responses 
oiuen« 

•  For  sliulatlons  that  require  greater  frequency  In  the 
feedback  schedule  and/or  greater  inforiation  than  is 
provided  by  nntural  feedbacki  use  artificial  feedback* 

•  Present  artificial  feedback  lith  natural  feedback  at  first 
and  then  gradually  fade  it  as  the  learner  tasters  the  task. 

•  Prouide  help  as  needed  (depending  on  tha  difficulty  of  the 
content)  at  firstj  then  gradually  fade  It* 

Bssessttent 

After  coftpleting  the  instructional  phases  of  ti^e  situlationi  a 
criterion  test  lust  be  adtinistered  to  determine  If  the  learner 
has  Mastered  the  content* 

•  Present  ne«  cases  as  test  iteis  and  include  the  full  range 
of  difficulty  and  diuergenca*    These  cases  should  be 
interchangeable  «ith  practice  cases* 

•  Use  a  scoring  f^^chanisi  and  establish  a  criterion  score  thot 
lust  be  Qchieued  for  nastery* 

•  Display  the  score  as  the  learner  progresses  through  the  test 
unless  such  a  run'^ing  score  interferes  with  the  nature  of 
the  real-«orld  task  or  prouldes  prompting  of  sote  kind* 

•  R  test  toy  be  done  as  port  of  the  practice^  prouided  the 
iteis  are  neifj  but  a  penalty  should  be  registered  for  ant; 
help  proulded  (both  pre-  and  post-response  help)* 

•  If  criterion  is  not  leti  iftoiediately  folloti  the  test  with  a 
thorough  debriefing.  It  should  provide  artificial  feedback 
for  ail  iiistakes  iode* 

Control 

The  issue  of  control  influences  all  coiponents  of  a 
siiulation.  The  prescriptions  that  follow  allow  the  learner  to 
exercise  control  ouer  soae  aspects  of  the  simulation  while 
■aintaining  systea  control  ouer  others*    To  soae  extent  user  or 
syslea  control  will  be  deterained  by  the  instructional  object iues^ 
but  in  general  the  following  prescriptions  apply  to  all  siaulat ions* 

•  Systea  control  of  the  leuel  of  coapiexittjj  including  a 
proulsion  for  the  teacher  to  input  the  appropriate  entry 
leuel  for  each  learner. 

•  Systea  control  of  the  learner's  progresxi  froa  one  leuel  to 
the  next  to  ensure  that  aastery  is  achieued  at  each  hue! 
before  allowing  the  li^urner  to  go  on  to  the  next  leuel* 
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•  Systeift  control  of  routine  features  (general  ity^  exampiej 
practicei  feedback  itene)  of  the  Initial  presentation  for  a 
new  principle  '"•^  procedure.    Then  permit  the  learner  to 
choose  to  see  additional  cases  in  exairiple  forn  or  to  go  baclc 
to  a  generality  or  exanple  at  any  tine  during  a  practice 
case. 

•  Systei  and  learner  control  of  help.  Prouide  some  help  to 
ail  learners  on  early  examples  and  practice^  then  fade. 
Permit  the  learner  to  select  additional  help  on  an  optional 
basis. 

«  SystefB  coriirbi'  should  require  the  learner  to  see  the 

introduction  the  first  time  the  simulation  is  used.  From 
then  on  access  to  the  introduction  should  be  optional  and 
under  learner  control. 

•  Prouide  the  option  for  both  system  (including  teacher  input) 
and  learner  control  of  test  criterion  to  prouide  maximum 
flexibility  of  use.    Learner  control  may  be  implemented  by 
aliouiing  the  learner  to  select  a  test  of  a  particular 
difficulty  leuel  or  to  specify  the  number  or  percent  of 
correct  ansmers  required.    In  some  situations  this  becomes 
highly  motiuational  in  that  the  learner  attempts  to  better 
his  or  her  score^  much  like  a  game^  each  time  he  or  she  uses 
the  simulation.    In  many  cases  the  teacher  may  select  the 
difficulty  and  criterion  leuel  for  mastery  by  setting 
specific  uariables  made  aua liable  in  a  learner  management 
section.    This  is  especluiiy  useful  for  indiuidual izat ion  of 
learner  assessment. 

Uoriations  on  the  General  Hodel 

Uhiie  it  appears  that  all  simulations  should  include  the 
prescriptions  described  in  the  general  model,  there  are  certainly 
many  aspects  of  a  simulation  that  should  uary  from  one  situation  to 
another^  depending  on  such  conditions  as  the  nature  of  the  behauior 
to  be  learned^  the  form  of  the  changes  that  occur^  and  the 
motiuational  requirements.    The  follooing  prescriptions  for 
uariations  on  the  general  model  describe  when  to  use  each  type  of 
simulation  and  what  it  should  be  like. 

Nature  of  the  behauior 

The  nature  of  the  behauior  being  simulated  will  determine  the 
nature  of  the  acquisition  and  application  stages  of  the  simulotioni 
including  the  mode  (expository/discouery)  and  form  of  manipulation 
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(observation  or  exploration).  Hence,  type  of  behavior  is  the  single 
fliost  iaportant  basis  for  prescribing  uariations  in  a  simulation. 

There  are  three  ftojor  variations  of  the  general  lodel  based  on 
the  three  types  of  content:  procedures,  process  principles,  and 
causal  principles.    Figure  2  presents  prescriptions  to  guide  the 
design  of  the  acquisition  ond  application  stages  for  each. 


insert  Figure  2  about  here 


Hs  previously  discussed,  the  genera! ity  can  be  presented  using 
an  expository  or  q  discovery  approach,  both  of  uihich  require  the 
presentation  of  a  prototypical  example.    The  learner  may  be  requires 
to  observe  only;,  or  to  manipulate  the  example  and  then  to  observe 
the  result.    Requisition  may,  therefore,  be  accomplished  by  a 
dtscouery  or  expository  approach,  either  of  which  may  present  the 
prototypical  example  by  observation  or  exploration.  For  the 
acquisition  stage  of  procedural  simulations: 

•  Use  an  expository  approach  because  it  is  not  feasible  or 
useful  for  the  learner  to  "figure  OMt"  the  generality. 
This  is  best  done  by  presenting  the  generality 
simultaneously  vith  q  prototypical  example  of  the  procedure. 

•  Require  the  learner  to  observe  the  example. 
For  acquisition  of  process  principles: 

•  Use  an  expository  approach  because,  as  with  procedures,  it 
is  neither  efficient  nor  effective  for  the  learner  to  engage 
in  a  tri(^'>and-error  search  to  discover  the  generality. 
This  is  usually  best  done  by  presenting  the  generality 
simultaneously  with  a  prototypical  example  of  the  process. 

•  Require  the  learner  to  explore  the  example,  if  possible. 
Exploration  requires  that  the  learner  turn  the  process  on 
and  off  in  the  example  and  then  observe  the  results. 

Causal  principles  are  quite  different  in  nature  from  procedures  and 
processes  because  not  only  must  the  principle  be  learned,  but  the 
routine  needed  to  apply  it  must  be  learned  as  well.    For  acquisition 
of  cousal  principles: 

«  Use  a  discovery  approach.    The  change  relationships  should 
be  clearly  presented  in  a  prototypical  example,  and  with 
help,  the  learner  can  be  lead  to  "figure  out"  the  principle, 
resulting  in  enhanced  understanding. 

•  Require  exploration  of  the  example  by  the  learner. 

Rfter  the  learner  has  acquired  the  generality,  the  simulation 
should  proceed  with  the  application  stage  to  teach  the  learner  to 
apply  the  generality  in  any  situation  that  might  be  encountered  at 
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the  criterion  ieuel  of  performance.    For  application  of  all  three 
types  of  content: 

•  if  the  task  is  fairly  difficult  to  ftaster^  precede  the 
practice  (o  component  of  the  general  node!)  »ith  divergent 
exaoiples  of  the  procedure^  process  or  causal  principle. 

•  Use  perfornance  practice  to  prouide  the  breadth  of 
experience  needed  to  achieue  accuracy  in  applying  the 
generality  to  diuergent  coses. 

•  The  number  of  exanplepnd  practice  cases  should  depend  on 
the  difficulty  of  the  task. 

Procedures  differ  froi  principles  in  that  autoaotization  is  usually 
necessary  to  ensure  sufficient  speed  of  perfornance  and  to  reduce 
conscious  cognitiue  processing  requirenents  during  performance. 
Thereforei  in  addition  to  the  prescriptions  abouej. 

•  Prouide  drill  practice  to  a  speed  criterion  after  the 
accuracy  criterion  has  been  reached  on  perforwance  practice. 

For  cQusqi  principles^  application  nust  teach  the  routine  for 
utiiiiing  the  principle,  as  well  as  the  appi ication  of  the  principle 
by  utilizing  the  routine.  Therefore^ 

•  Require  the  learner  to  obserue  demonstrations  of  the  routine 
as  it  is  utilized  to  apply  the  principle. 

•  Use  help  Xo  clarify  and  emphasize  the  steps  in  the  routine. 

•  Then  provide  diuergent  examples  and  performance  practice 
using  the  routine  to  apply  the  causol  principle. 

To  design  the  example  and  practice  casesj  it  is  important  to 
analyze  the  kinds  of  cognitiue  behauiors  that  are  learned  for  each 
type  of  content.    For  a  procedure  the  learner  is  expected  to 
execute  a  sequence  of  steps  and/or  decisions  to  achieve  a  particular 
goal.    For  a  process  principle  the  learner  is  expected  only  to 
describe  a  sequence  of  coturally  occur ing  events.    For  a  causal 
principle^  however^  we  have  identified  three  different  types  o^ 
behaviors:  predict ioni  explanation^  and  solution. 

In  terms  of  causes  and  effects^  the  prediction  behavior  is 
expected  when  the  objective  requires  the  learner  to  predict  the 
likely  effect(s}|  given  a  set  of  causes.    R  simulation  that  presents 
a  variety  of  lens  shapes  and  asks  the  learner  to  predict  the  effect 
of  each  on  light  rays  requires  prediction  behavior.  Explanation 
behovior  is  expected  when  the  objective  asks  the  learner  to  identify 
the  likely  cause(s)^  given  an  effect.    Rn  explanation  simulation 
might  require  the  learner  to  identify  the  causes  of  pollution  in  a 
lake,  the  physical  traits  of  parents  of  a  particular  fruit  fly  or 
the  reason  for  an  increase  in  air  pressure  under  specified 
conditions.  Solution  behavior  is  expected  mhen  the  objective 
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requirea  the  learner  to  select  and  inplenent  the  necessary  causes  to 
bring  about  a  desired  effect  (i.e.,  to  engage  in  problea  soluing). 
''LeaonQde''  is  a  solution  siaulation  thot  requires  the  learner  to 
iQxiftize  his  or  her  profits  using  i^novledge  of  the  lau  of  supply  and 
deaand. 

Hence,  there  are  fiue  types  of  behaviors:  execution, 
description,  prediction,  explanation,  and  solution.     Figure  3 
prescribes  the  nature  of  the  stiaulus  and  response  for  the  practice 
cases  for  each  of  the  five  types  of  behaviors.    Often,  the  learning 
objectives  for  content  coaposed  of   causal  principles  do  not  require 
a  specific  fora  of  response  but  rather  the  general  ability  to  use 
the  principle  in  any  fora.    If  this  Is  the  case,  use  a  variety  of 
predict ioHj  explanation^  and  solution  siaulations  to  provide  the 
learner  aith  greater  divergence  of  behaviors.   For  complex  content 
require  prediction  and  explanation  behavior  for  individual 
principles  first,  then  solution  behavior  for  integrated  practice  of 
a  nuaber  of  related  principles. 


Insert  Figure  3  about  here 


Coaplexity  of  the  Coniept 

Before  the  actual  design  process  begins,  the  complexity  of  the 
desired  content  and/or  behavior  aust  be  analyzed  to  determine  If  it 
can  be  present. ed  as  an  integral  ihole  or  if  it  aust  be  broken  douin 
or  simplified.    This  ail  I  deteraine  the  kind  of  macroievei 
sequencing  for  the  domain-specific  content. 

•  If  the  conlent  is  relatively  simple  and  involves  a  limited 
number  of  constructs  (principles  and  procedures),  teach  it 
as  an  integral  whole  (Cropper,  1983;  Landa,  1983). 

•  if  the  content  is  difficult,  siaplify  it  using  an 
elaboration  approach   (Reigeluth  &  Stein,  1983). 

if  the  content  is  procedural,  the  elaboration  theory 
describes  a  aeihodology  for  siapl ifying  the  procedure  until  it  is 
simple  enough  to  learn  as  an  integral  ahcie  (Reigeluth  &  Bodgers, 
1980;  Reigeluth  &  Rawson,  in  press).    Then  that  '"epitome'"  is 
gradually  elaborated  upon,  one  level  at  a  time,  until  the  complete 
procedure  (as  called  for  by  the  objectives)  is  mastered.  Although 
the  basics  of  that  methodology  also  apply  to  solution  tasks,  some 
extensions  of  that  aethodology  are  useful.    Space  liaitations  aake 
it  iapractical  to  include  these  prescriptions  in  this  paper. 

If  the  content  is  primarily  principles,  the  elaboration  theory 
describes  a  aethodology  for  simplifing  the  task  by  requiring  use  of 
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only  t!;e  one  or  tuo  nost  inportant  and  nost  broadly  applicable 
principled  for  aaking  the  predict ionj  explanationj  or  solution 
(Relgeluthj  1987).    Once  that  principle  (or  tuio)  has  been  taught  in 
an  "epitone"  sinuiationj  Bore  detailed  and  precise  principles  are 
then  taught  as  ''elaborot ione"  until  the  conplete  domain  of 
principles  (qs  called  for  by  the  object iues)  is  lastered.  Such 
siaple~to-co«plex   sequencing  lithin  a  siiulation  is  extreaely 
iaportant  to  the  Instructional  quality  of  the  siauiatlon. 

Leorner  Part icipot ion 

The  type  of  learner  participation  also  uar ies  depeVding  on  the 
nature  of  the  content  or  behauior  being  sinulated.    Ue  haue 
therefore  characterized  the  type  of  learner  participation  required 
for  each  of  the  three  types  of  content  described  abooe:  procedurej 
process  principle^  and  causal  principle.    The  learner  role  in  the 
acquisition  stage  is  different  fro«  that  in  the  application  stage, 
fliessi  and  Trollip  (1985)  haue  identified  three  types  of  learner 
behauior:    obseruingj  playing  a  rolej  and  controlling. 

Figure  4  suftftarizes  the  prescribed  learner  role  for  each  type 
of  content  during  the  acquisition  and  application  stages. 

•  For  procedures  require  the  learner  to  observe  the  simulated 
perforaance  of  the  procedure  and  then  to  perform  the 
procedure  by  playing  a  role  during  the  application  stage. 

•  For  process  principles  require  the  learner  to  obserue  the 
naturally  occuring  euents  during  acquisition  and  then  to 
describe  the  sequence  of  euents  by  control  ing  the 
sirDuiation  (for  exaaplej  placing  the  euents  in  the 
apppopriote  sequence)  during  app!  i cat  iQn^i^»  For  causal 
principles  require  the  learner  to  manipulate  (control) 
examples J  observe  causes  or  effects,  and  "figure  out"  the 
principle  during  acquisition.    Then,  for  appMcationj 
require  the  learner  to  ipiay  a  role  in  which  the  principle 
is  applied.    For  ^-^amplei  if  th   principle  is  the  law  of 
supply  and  demandj  the  role  may  be  that  of  an  economist 
predicting  effects  of  changes  in  price  or  a  businessman 
trying  tc  maximize  his  or  her  profits. 


Insert  Figure  1  about  here 

in  the  case  of  procedures  and  causal  principles  the  learner 
can  practice  in  conditions  simiiar  to  those  of  real  life.    He  or  she 
can  actually  perform  the  procedure  or  apply  the  principle  under 
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reaiistic  conditions.    SiKulations  ore  often  the  only  means  of 
indtruction  that  can  nake  this  type  of  practice  possible. 

Fori  of  Changes 

fliessi  and  Troliip  (1985)  haue  categorized  sinulations  on  the 
basis  of  the  physical  or  non*physical  forn  of  the  changes  being 
'aright*    R  procedure  is  physical  when  physical  nouenent  is  to  be 
leorned,  as  in  a  flight  siiulation.    R  principle  is  physical  when 
physical  changes  are  to  be  observed  by  the  learner,  as  is  the  case 
In  a  sittUiation  of  uolcanic  action.    flII  other  procedures  and 
principles  are  non-physical.    The  physical  or  non-physical  nature  of 
the  behauior  being  si.'nulated  is  the  najor  factor  in  determining  the 
representot ion  fora  of  choice.    In  genercl  physical  changes  require 
greater  realism  of  presentation  than  non-physical  changes.  The 
following  prescriptions  specify  representation  forms  in  order  of 
preference  for  each  simulation  category. 

•  Physical  procedure:  enact iue  (3-d i mens ionai  simulation)^ 
iconic  (uideo  or  graphics) 

•  Physical  principles:    iconic  (for  enhanced  transfer  and 
motiuational  appeal) 

•  Hon-physical  procedures:  iconic  (if  possible),  syr^bolic 

•  Non-physical  principles:  iconic  (if  possible),  visual 
symbolic  (diagrams,  graphic  art,  graphs),  verbal  symbol ic 
(text,  numerals) 

Hot ivat ionai  Requirements 

If  the  anticipated  attitude  of  the  learners  tou^ards  the  task 
requires   highly  motivational  Instruction,  a  game-type  simulation 
should  be  used.    Some  literature  exists  prescribing  components  of 
simulation  games  (Priestley,  1984;  Carson,  1987).    The  specific 
prescriptions  that  follow  provide  a  brief  summary. 

•  Establish  rapport  between  player  and  computer  at  the 
outset  by  providing  the  computer  with  a  name,  by  using  the 
player's  name  in  computer  responses  and  by  using  the  first 
person  in  computer  responses  to  the  player. 

•  Present  the  rules  of  the  game  usually  in  the  form  of  text 
accompanied  by  an  example. 

•  Use  a  non-zero  bosed  scoring  system,    tlaintain  records 
of  scores,  tiwed  responses,  number  of  attempts  (correct  and 
incorrect),  ^;vels  of  difficulty  attempted. 

•  Create  a  competitive  situdtion  in  which  the  player  wins 
by  beating  the  computer,  another^  player,  or  his  or  her  own 
score. 
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•  PpoMide  player  control  ouer  sone  aspects  of  the 
siiuiatioRi  such  qs:  nunben  of  playersi  entry  leuel  of 
difficultyj  choice  of  opponent  (nay  include  coifiputep  or 
ar^other  piayer)j  response  tiaej  length  of  pioy. 

Conclusion 

Ue  have  prouided  some  prescriptions  for  the  design  of 
coiputer-based  simulations  in  the  fori  of  a  general  nodel  and 
uariations  on  the  general  lodel  based  on  the  nature  of  the  task  and 
learner.    These  prescriptions  are  just  the  first  step  in  an  attempt 
to  construct  a  validated  prescriptive  theory  for  the  design  of 
computer-based  simulations.    Considerable  research  and  extensive 
field  tests  are  needed  to  provide  the  information  necessary  for  both 
confirmation  and  revision  of  the  various  aspects  of  the  theory.  It 
is  our  hope  that  this  theory  vili  provide  a  useful  framemork  for 
conceptualizing  future  research  studies  and  that  revisions  and 
enhancements  of  the  theory  vill  be  proposed  from  such  research. 
Heunihilei  although  caution  should  be  exercised  regarding  the 
validity  and  optimal ity  of  the  theory^  it  is  our  hope  that  it  will 
serve  as  a  useful  guide  to  designers  of  computer-based  simulations 
and  that  its  usefulness  »ili  groai  as  the  ej^cle  of  research  and 
revision  continues. 
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Ho  pari icipat ion  Participation 


flcquidit ion 

by  expoditopy  approach: 
General  ity  oiith  a 
Prototypical  Example 

by  discovery  approach: 
Prototypical  Example 
to  Figure  Out  the 
General ity 

without  criterion 

by  criterion  performance: 

flppi  i cat  ion 

performance: 

Practice  mith  Feedback 

Examples 

Exaiple 

liiithcut  manipulation: 
Obseruat  ion 

by  manipulation: 
Explorat  ion 

Figure  !•  Feature- function  map. 
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URRlinTIONS  OH  THE  CEHERflL  HODEL 


Requisition  Rppiication 


Procedure 

Expository  by  obseruation: 
General ity  v 
Prototypical  Exainple 

Oiuergent  Examples  ^ 
Performance  Practice 

(accuracy)  + 
Dri 1 1  Practice  (speed) 

Process 

Expository: 

Diuergent  Examples  + 

Principle 

General Ity  + 

Performance  Practice 

Prototypical  Example 

(accuracy) 

Causol 
Principle 

Oiscouery  (of  principle) 

by  explor at  ion: 
Prototypical  Example  of 

the  principle 

Diuergent  Examples  of 

the  principle  + 
Oidcouery  (of  routine) 

by  ob3ei*uation  (uia 

Diuergent  Examples  of 

the  routine)  + 
Diuergent  Performance 

Practice  (accuracy) 

Figure  2.  Uariations:  Features  for  functions  for  each  type  of  content. 
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KIHD  OF 
SinULflTIOH 


flCQUiSITiOH 


flPPLICRTIOH 


Procedure 
Process  Principle 

Obserue  a  role 

Play  a  role 

Observe 

Control 

Causal  Principle 

Control  and  Obserue 

Obserue  (routine) 

(for  exploration) 

P!ay  a  roie 

(practice) 

1 

Figure  4.    Uarlations:  Role  of  the  Learner 
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Type  of  Siiulotion 

■1  mm  A   mm                       Jf^  m 

ifoture  ut 

rract ice 

Behauior 

Exaiple 

Response 

Stimulus 

Execution 

(Procedure) 

Add  fractione  or 
Select  Math 
operation 

Use  a  sequence  of 
steps  and  decisions 

Goal  J  inputs 

Description 

(Proces5e$) 

Plant  Life  Cycle 

Describe  a  sequence 
01  eiTects 

Situation 

Predict  ion"^ 

Predict  effect 
of  increased 

^1  1 

Predict  the  likely 
ei tects 

Causes 

Explanation^ 

identify  cause  of 
increased  dentand 

Manf  S  fii  f  Ha  Mlrolii 

iQeniiiy  ine  iiKeiy 
causes 

Solution^ 

flaxiaize  profits 

Select  md  imp  lenient 
the  necessary  causes 

Desired  effect 
t  inputs 

♦Cause-effect  Principles 


Figure  3.  Prescriptions  for  the  nature  cf  the  stimulus  and  response  for 
practice  cases  In  flue  types  of  simulations. 
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It  18  Widely  recognized  that  our  educational  systm  has  sone  inportan^ 
shor  tooBinga.  Ihia  paper  proposes  that  such  "problems*  as  lack  of  teacher 
incentives,  poor  student  motivationy  la;  k  of  leadership,  and  lack  of 
community  support  are  in  fact  Just  effects  of  a  more  fundamental  problem* 
Just  as  the  one-*room  schoolhouse,  which  was  so  appropriate  for  an 
agricultural  society,  proved  to  be  inadequate  for  an  industrial  society,  so 
our  present  system  is  proving  to  be  inadequate  for  an  information  society* 
It  is  the  fundamental  structure  of  our  educational  system  that  is  at  the 
heart  of  our  current  problems*  For  example,  it  is  our  group-based, 
lock-stepped,  graded,  and  tim«^a?iented  ^stem  that  has  the  dubious 
distinction  of  effectively  destroying  the  inherent  desire  to  learn  in  all 
but  a  small  percent  of  our  children*  Furthermore,  micro  computers  are 
accelerating  the  trend  t^ard  increased  use  of  nonhuman  resources  in  the 
education  of  our  cbildre  i,  and  the  current  structure  of  our  educational 
:^stem  cannot  adequately  accomodate  the  effective  use  of  these  powerful 
educational  tools*  But  what  alternatives  are  there?  Until  recently  there 
have  not  been  any  viable  ones,  but  our  pedagogical  knowledge  has  now  evolved 
to  the  point  where  there  is  a  viable  alternative  to  the  present  structure* 
This  article  describes  a  general  approach  and  a  specific  strate^  for 
effecting  the  sorely  needed  structural  changes,  and  describes  some  initial 
progress  on  implementing  that  strategy*  This  initial  progress  is  a 
preliminary  "blueprint"  outlining  the  structural  characteristics  that  a 
"third-wave"  educational  system  should  have* 
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niere  is  &  growing  lack  of  confidence  in  our  present  public  school 
SfAtm.  JXliA  Jihgas^JM  has  said* 

Like  ease  vast  jury  gradually  and  reluctantly  arriving  at  a 
verdiott  politiciansy  educatcM^s,  and  especially  millions  of 
parents  have  come  to  believe  that  the  U.S.  public  schools  are  in 
parlous  trouble.  1 

^bcfifficle  oL  Si^exL  Education  reports  that  educators  and  noneducators 
alike  are  calling  fc?  sweeping  reforms  of  Americans  public  schools«2 

The  recent  M^tilonal  Commis^on  on  Excellence  in  Education  was  created 
because  of  *the  widespread  puULlc  perception  that  something  is  seriously 
remiss  in  our  educational  system. "3  The  Commission's  report,  entitled  "A 
Nation  at  Bisk:  The  Imperative  for  Zducatf  onal  Reform**,  cites  Faul  Copperman 
as  drawing  the  conclusion  tb&«;  **f<H?  the  first  time  in  the  hist(»?y  of  our 
country,  the  educational  skills  of  one  generation  will  not  surpass,  will  not 
OQual,  will  not  even  approach,  those  of  their  parents,  ^'il  The  Commlsslbn 
concluded  that,  **if  an  unfriendly  foreign  power  had  atempted  to  impose  on 
America  the  medlocr^a  educational  performance  that  exists  today,  we  mifi^t 
well  have  viewed  it  as  an  act  of  war*  "5  As  Faul  Berman  has  recently  noted^ 
**The  debate  is  no  longer  over  whether  American  education  Is  in  trouble,  but 
over  what  should  be  done.  ^6 

What  1b  the  jQaua^  qf  Our  ft*oblems? 

Before  we  can  identify  what  should  be  done,  we  oust  identify  the  causes 
of  the  current  problems  with  American  education.  The  Commission  cites  poor 
content  (we  are  teaching  the  wrong  things),  insufficient  learning  time  (we 
are  not  teaching  it  long  enough),  poor  quality  of  teaching  (we  are  not 
teaching  it  well  enough) ,  low  standards  and  expectations  (we  are  not 
demanding  enough  frcm  the  students),  and  lack  of  leadership  (we  are  not 
getting  the  kinds  of  initiative  and  direction  that  are  needed  from  our 
administrators).  But  are  these  really  the  causes?  Or  are  th^  ^mptcms  of 
a  more  fundamental  cause?  IWo  things  may  be  helpful  to  answer  this 
question:,  (1)  analyzing  vhat  goes  '^n  in  a  typical  school  and  (2)  looking  at 
ways  of  Improvlxig  systciss  in-  general. 

Imagine  you  are  a  high  school  teacher.  You  want  very  much  to  excite 
your  students  about  learning.  How  are  you  going  to  go  about  it?  You  have 
been  handed  a  list  of  over  a  rhundred  students  in  fout'  classes*  You  have  a 
textbook  that  you  are  required  to  use  and  a  year-*end  exam  for  which  you  need 
to  prepare  the  "students,  so  that  all  but  a  few  minutes  of  classtlme  per  week 
must  be  carefully  scheduled  in  advance.  On  the  first  day  of  classes, 
twenty-five  or  thirty  students  will  troop  into  your  classroom  at  tlie  ri.ag  of 
a  bell  and  will  troop  back  out  ko  minutes  or  so  later  at  t  ie  ring  of  another 
bell,  regardless  of  whether  the  great  moLn.it  of  insist  you  have  spent  the 
entire  class  working  up  to  is  still  two  minutes  away.  The  stud^ats  will 
come  into  your  class  with  very  different  levels  of  knowledge  about  your 
subject;  most  will  not  be  very  iiiterested  in  it;  and  practically  all  will  be 
hoping  to  be  entertained  more  than  educated.  You  dbn^t  really  know  anything 
about  any  of  those  students  as  individuals,  so  you  are  forced  to  focus  your 
attention  on  the  content  and  how  you  will  deliver  it  to  the  "average" 
student  in  the  class,  rather  than  focusing  on  the  individuals  you  are 
teaching  and  how  you  can  addresr  the  needs  and  interests  that  each  of  them 
has. 

Is  a  longer  school  day  really  the  solution  to  your  problems?  Or  better 
teacher    training?.      Or   higher   expectations?      Will  such  reforms  help  to 
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matain  a  loTe  of  taaohlng  in  the  teaoher  7>r  to  instill  a  love  of  learning 
in  the  students?  Mllbr«jr  I'cLaughlln  ^  asaoolates  at  Stanford  University 
have  noted: 

Mangr  of  the  current  reform  efforts  alaed  at  improrj^lnj:  the  quality 
of   teaoher^s  fall  to  oonaider  the  oonflguration  of  conaltions  that 
leads     even     the     most     dedicated     trachca^s     to  experience 
dencralizatlon  and  a  sense  of  personal  failure.    Indeed,  som>^  of 
the  organizational  and  environaental  features  that  contribute  most 
prominently  to  this  sense  of  failure  are  also  basic  aspects  of  the 
current  system  of  education  in  the  JJ.S.7 
Sioilarly,    Willie   Hairley   notes  that  "Motivating  teachers  without  changing 
other   conditions   that   affect    teaching  will  not  only  limit  the  effect  of 
incentives,    but  may  cause  frustration  and  alienation.      During  ry  years  as 
a   bi£^   school    teacher,    I   came   to  understand  what  many  teachers  have 
complained   of:       that   the  .afiCUfiture  of  the  educational  system  is  the  root 
cause  of  most  of  the  problems  that  beset  our  edik^tional  system. 

What  do  we  mean  when  we  refer  to  the  "structure"  of  our  educational 
^stem?  The  structure  is  the  basic  organlifiation  of  the  teaching  process. 
The  major  structural  aspects  of  our  present  system  include  (1)  £CfiUB 
learning;  having  knowledge  delivered  to  children  in  groups  of  20  to  40  at  a 
time,  sudi  that  all  children  receive  the  same  content  at  the  same  time  and 
V  .te;  (2)  conahanfc.  xQjtaUon:  rotatl^tg  the  children  from  one  teacher  to 
another  every  45  minutes  or  so;  (3)  tlmt>>baaed  grade  levels:  requiring  all 
children^  to  "serve"  the  same  amount  of  time  before  they  are  allowed  —  or 
forced^  as  the  case  may  be  to  progresc  .to  n&t  levels  of  learning, 
regardless  of  when  (or  even  if)  they  hwe  mastfu?ed  all  the  necessary 
knowledge  and  sldlls,  (4)  JL^oL&tloD:  naving  all  learning  occur  within  the 
confines  of  the  school  walls  and  not  encouraging  (nor  usually  even  allowing) 
parents  or  other  segments  of  the  community  to  participate  and  cooperate  in 
the  teaching  process;  and  ^3)  adminlatrattve  organizatton:  having  a  single 
large  school  in  a  district,  with  administrators  who  are  not  also  teachers 
and  teachers  who  are  relegated  to  a  less  influential  and  professional 
"staff"  role  within  the  educational'  ^stem. 

Of  course  there  are  other  causes  of  our  problems  besides  the  structure 
of  our  educational  ^stem.  Bad  teachers  do;  exist,  lack  of  parental  concern 
for  their  children  does  exist,  and  so  forth.  But  there  Is  increasing 
recognition  that  the  ma  lor  cause  of  the  current  problems  with  our 
educational  ^stem  is  the  basic  structure  of  that  ^^stern.  Theodore  Sizer 
states: 

Can  students  learn  how  to  learn  to  "stu<<y, "  when  th^  are  rushed 
from  class  to  da;:  over  a  seven-*period  day,  where  th^  are  being 
taught  by  dix  or  seven  different  teachers,  no  one  of  whom  sees 
them  more  than  five  hours  per  veek  (and  usually  in  groups  of  over 
20  students),  and  when  there  is  rarely  any  unequivocally  r^^orved 
time   for    private    stu<<y  (homework,  atudy  halls)?   Of  course  not. 

Until   we   honestly   confront    the   inadequacy    of  school 
structure,  we  will  continue  to  cheat  students,  frustrate  teachers, 
and  waste  money. 9 
In  1  JSLat^iJallfijl  &2hj^  John  GocJlad  concludes: 

...    far-reaching"  restructuring   of   pur    schools  and  indeed  ovr 
system  of  education  probably  is  required  for  us  to  come  even  clcr^a 
to   the  educatlpnai  Ideals  we  so/^egularly  espouse  foi^  this  nation 
and  all  it/f  people.  10 
Anne  Westcott  Dodd  states: 
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Band»Ald  aqlutlona  proliferate:  a  longer  school  day  and  year,  more 
required  aubJeotSt  aore  hoMeworky  hl^er  pay  for  teachers.  But 
sore  of  the  same  is  not  neoeaaarlly  laprovenent.  America  can 

develop  a  whole  nev  structure  for  public  education  ••••11 
Maurice  Gibbons  laments^,    "Ironloallyt   when   the  old  paradigm  falls  into 
diareputet  we  do  not  make  major  changes;  insteadt  we  focus  more  Intensely  on 
those   things  we  have  always  done  ••••^IS   Selma  Wassermann  talks  about  an 
alternative  i^stem 

in  which  each  learner  sets  his  or  her  own  pace  in  working  tcward 
mastery  of  course  material;  •••in  which  teachers  play  diagnostic 
and  facultative  roles,  rathw  than  controlling  and  Judging  ones; 
in  :hlch  the  initiative  of  the  learners  is  cultivated  rather  than 
thwarted  ••••13 

Harold  Shane  tallcs  about  "a  growing  need  to  j^fidfiLflLgD  —  not  merely  to  reform 
—  education  in  the  U^S^Mll  Ernest  Boy er,  15  Soymour  Sarason,l6  and  Richard 
BrandtIT  all  advocate  some  structural  reforms,  and  the  list  goes  on  and  on^ 
As  Paul  Bfirman  put  it,  "The  oonoluslon  is  Inescapable:  American  education, 
Jb^  it      JB£S£  SttSUiX^ed.  has  reached  the  limits  of  its  effectlveness^"l8 

XS&BLSaring  Systems 

Educational  ^sterns  are  like  other  kinds  of  systems  in  many  ways^  How 
are  other  kinds  of  ^sterns  Improved?  Our  transportation  system  consisted 
primarily  of  the  horse  for  a  very,  long  time;  Like  the  one--room^  scboolhouse, 
the  horse  was  very  flexible  for  meeting  the  needs  of  the  individual;  you 
could  go  almost  anywhere  you  >/anted  to*  But  there  were  problems  with  the 
horse^  It  wasn^t  very  fast  or  very,  comfortable,  especially  in  bad  weather^ 
Now,  some  people  spent  a  lot  of.  time  trying  to  reform  the  prevailing 
structure  by  doing  such  things  as  breeding  faster  horses  and  building  better 
roads  and  bridges  to  improve  the  horse*  s  speed,  or  making  more  comfortable 
saddles  and  creating^  carriages  for  the  horse  to  pull  to  improve  comforts 
But  the  gains  to  be  made  were  small  compared  with  the  development  of  an 
alternative  structure,  the  railroads 

The  railroad  was  far  faster,  more  comfortable,  more  reliable,  and  more 
efficient  than  the  horse^  It  could  transport  many  L^ore  people  much  greater 
distances  far  more  cost^effectively.  But,  like  our  current  educational 
system,  it  was  mu^  less  flexible;  you  were  greatly  restricted  as  to  where 
you  could  go  and  when^ 

As  society  has  continued  to  change,  our  transportation  needs  have  also 
changed^  We  must  travel  ever  greater  distances  in  less  time,  and  people 
need  to  have  much  more  flexibility  as  to  when  and  where  they  will  go^  Many 
people  have  spent  much  time*  ^fine-tuning"  the  rail-^oad^  But  the  **quantum 
leap"*  again  came  from  an  alternative  structure,  in  this  case  one  that 
entails  the  use  of  a  variety  of  transportation  media,  primarily  the  airplane 
and  the  autcmobile« 

As  the  one^room  schoolhou  a  "first*-wave^  educational  ^stem,  was 
appropriate  for  what  Alvin  Toffler  qills  a  »»first-wave"  agrarian  society,  19 
so  our  present,  second-*wave,  educational  ^stem  has  a  structure  and 
philosophy  that  were  appropriate  for  a  "second-wave"  industrial  society^ 
Althou^  thei'e  are  problems  with  the  industrial  production  model  of 
schooling, 20  one  cannot  help  but  note  some  structural  similarities  to.  an 
assembly  line,  whereby  students  move  from  one  specialist  teacher  to  another 
at  the  ring  of  a  bell  to  have  a  new  component  of  education  added  to  them^  A 
"thirdrHave"  astern  will  provide  a  quantum  leap  for  meeting  the  changing 
needs   of  our    society,    and    like  our  current  transportation  ^stem,  it  is 
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lltoly  that  it  will  sake  use  of  a  varied  of  means  of  learnlog.  Including 
peer  tutorlngf  discusaion  groups,  projects,  and  group  activities  of  various 
klndst  in  addition  to  well  designed  individualized  resources  and  learning 
envlronient8.21 

Each  structural  change  that  hiis  occurred  in  our  transportation  3ystera 
has  become  possible  only  bf  the  advance  of  technology »  and  in  fact 
technological  advances  have  made  the  rise  of  ^teriiatlve  structures 
inevitable*  But  the  change  is  never  revolutionary i  it  is  evolutionary. 
Horses  are  still  used  for  transportation  in  seme  places.  Many  trains  are 
still  in  use  today*  And  there  are  still  many  one-room  sdioolhouses. 
Structural  reform  is  one  of  gradual  replacement  in  places  where  the  societal 
needs  for  change  are  strongest* 

The  process  of  structural  reform  in  education  will  be  a  slew  one  for 
another  reason  as  well*  Ihe  more  advanced  our  technologyt  the  more  room 
there  is  for  improvements  through  fine  tuning  a  structure.  Look  at  how  far 
the  airplane  has  come  sloro  the  Hrl^t  brothers*  early  days*  How  long  was 
It  between  ELt^  Hawk  and  the  first  trans-oceanic  f llc^t?  Row  mudi  longer 
until  the  first  jet  planes?  . 

Althoui^  the  change  may  be  slow  and  gradual i  it  will  also  be  sire.  We 
can  already  see  technological  developments  of  the  "Information  Age*  that  are 
making  structural  reform  inevitable.  Since  the  invention  of  the  printing 
pressi  there  has  been  a  gradual  but  steady  increase  in  the  use  of  nonhuman 
resources  in  the  classrocmi  including  textbooks^  workbookSi  handout s,  and 
audlo-^i'isual  materials  of  various  kinds.  Now,  it  seems  that  micro 
computersi  because  of  their  interactive  capabilitlesi  are  greatly 
accelerating  this  trend.  We  are  already  reaching  the  point  where  the 
current  structiu?e  of  our  educational  ^stem  can  no  longer  adequately 
accomodate  the  effective  use  of  such  resowces.  As  more  and  better 
resources  beccnae  available  to  relieve  teachers  of  some  of  their  core 
routinci  boring  taskSt  we  are  likely  to  find  even  greater  internal  pressure 
for  schools  to  adopt  an  alternative  structure. 

As  we  enter  deeper  into  a  ^'third-wavci  ^  highly  technologicali  rapidly 
changing,  -^^formation-oriented  sooie  the  present  structure  of  our 
educational  :ysteffl  will  biacome  more  and  inore  inadequatci  both  fron  the 
society's  point  of  viw  and  from  the  scAooI's  point  of  viofi  not  to  mention 
the  child's  point  of  view.  According  to  Nalsblti  an  information  society 
requires  ^a  different  kind  of  personi  one  who  is  more  of  an  analyzer, 
evaluator,  problem  solver  and  creative  thinkeri  one  who  has  more  initiatlvei 
more  love  of  it^^rnlngi  and  more  responsibility  for  his  or  her  learning  and 
V  ^cislon-naklng.22  A  third-wave  .educational  ^stem  will  provide  a  quantum 
iaap  in  producing  this  kind  of  person. 

In  her  e.:cellent  analysis  of  school  reform  reportSi  Patricia  Cross23 
coupares  the  kinds  of  structural  reform  needed  in  schools  with  the  kinds  of 
structural  changes  tatdi^  place  in  businesses  as  outlined  by  Peters  and 
Waterman  in  their  ^  jst-selllng  book,  Jn  Search  pf  Excellenoe.2ii  She 
condudrs  that 

In  the  long  run,  would-be  reformers  may  be  dcing  more  harm  than 
good,  If  they  trananlt  the  message  that  state  officials  can 
legislate  and  regulate  educational  excellence  without  paying 
attention  to  the  task  of  creating  climates  of  excellences  at  the 
local  level.  ...  I  have  concluded  that  our  commitment  to  the 
lock-step,  time-defined  structures  of  education  stands  In  the  way 
of  lasting  progress.  It  is  simply  unreal  istic  to  think  that  all 
students   can  learn  from  the  sasie  materials,  to  the  same  standards 
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of  performanoet  in  the  aame  aaounts  of  tim6|  taugjbt  by  the  same 
iaethod8.25 

In  8um|  as  we  advance  Into  the  Information  agei  our  highly 
regimented,  graded,  lock-stepped,  group-based,  and  time-oriented 
rather  than  achievement-oriented  system  is  less  and  less  able  to 
meet  the  needs  of  the  individual,  the  socie^,  and  the  school 
itself.  Changing  the  curriculum,  lengthening  the  school  day,  and 
legislating  hi^er  standards  are  band-aid  approaches  to  fixing  a 
broken  leg;  ani  the^  are  likely  to  6q  as  much  harm  9s  good  in  the 
long  run. 

In  reference  to  the  problems  cited  ly  the  Commission's 
report,  it  is  the  structure  of  our  educational  i^stem  that  renders 
the  selection  of  jCQjitfint  relatively  insensitive  to  teachers  and 
parents  ~  the  two  groups  that  perhaps  should,  as  a  team,  have  the 
strongest  voice  (with  Information  and  advice  provided  to  them  by 
'^curriculum  experts*  and  other  concerned  people)*  It  is  the 
structure  of  our  educational  ^stem  that  leads  to  the 
establishment  of  ^minimiam  at^n^^da*^  and  expectations  that  are 
usually  tailored  to  the  least  capable  students  in  a  llass.  It  is 
the  structure  of  the  system  that  restiits  ih  a  very  anall 
propox-tlon  of  theJslBft  in  school  be5tig  spent  on  actively  learning. 
It  is  also  the  structure  of  the  educational  system  that  works 
against  ^u^oliJ^  Jisasdlii^  by  making  it  harder  to  teach  well  and  l^y 
dimini.!3hing  the  rewards  and  incentives  for  quality  teaching. 
Similarly,  the  structure  of  our  system  does  not  reward  the  kinds 
of  leadership  that  are  needed,  and  in  fact  it  often  rewards  (or  at 
least  promotes)  good  bureaucrats  and  public  relations  people 
instead  of  good  educational  leaders. 

But  if  this  is  true,  how  do  we  kno».  that  an  alternative  is 
feasible  new?  First,  it  is  certain  that  an  alternative  will  never 
be  feasible  if  we  don't  work  to  develop  it.  If  current 
feasibility  were  a  liecess&iy  condition,  the  Wright  brothers  would 
never  have  gotten  off  the  ground.  But  we  are  well  beyond  Kitty 
Howk  in  the  developnent  of  a  **third-wave*'  educational  systm.  The 
alternatives  to  a  group- based,  lock-stepped,  time-oriented,  graded 
system  require  the  availability  of  well-designed  learning 
resources  and  environments  that  are  at  once  highly  effective  and 
highly  motivating.  Infcx^mation  technologies  make  it  possible  to 
create  far  better  learning  resources  and  enviroiments  than  has 
ever  been  possible  before,\  and  those  technologies  are  reaching  a 
level  of  power  and  af fordatility  that  mrJce  them  cost-effectively 
competitive  for  many  educational  tasks. 

But  **hard**  technology  (equipment)  is  only  half  the  story.  We 
haven't  known  enough  about  how  to  design  effective  and  appealing 
learning  resources  and  environments  to  make  alternative  st^ructures 
for  education  feasible.  Finally,  that  situation  is  changing  and 
has  in  fact  alreadly  changed  enough  so  that  a  third-wave 
educational  system  is  feasible.26  The  important  question  then 
Sec(Hnes,  ^hat  would  be  a  workable  approach  for  determining  the 
oest  structure  and  for  implementing  that  structure?** 

An  Apjyoaoh  f£L  improving  .Eubllc  MISAXISH 

Many  problem  solvers  in  business,  indus<-*^y,  and  education 
feel    that   Initial    efforts   should  entail  thinking  in  the  ideal, 
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fc:?0attlog  twporarlly  about  oonatralnts,  and  later  cofflpronlalng 
aa  neceaaary  to  Ifflplcnent  a  workable  plam  When  working  with 
profaaaora  to  kelp  tha  to  improve  their  oouraes,  ^racuse 
Uniyaraity^a  Center  for  Inatructional  Development  has  found  that 
man!"  aolutiona  that  are  initially  thou^t  of  as  unworkable  under 
current  constraints,  are  in  fact  workable,  and  that  much  better 
resulta  are  achieved  by  initially  thinking  in  the  ideal •  In  the 
ultimate  analyais,  this  usually  proves  tr^  be  the  most  practical  of 
all  approaches. 

Another  important  concern  with  respect  to  an  approach  for 
improving  public  education  is  that  anything  beyond  fine-tuning  of 
apy  ay  stem  requires  ^aten-wide  planning  and  modification.  Any 
aysteoi  that  has  evolved  over  as  many  decades  as  lias  our  public 
education  ^atem  haa  certainly  developed  many  interdependent 
parta;  and  a  basic  tenhet  of  ^steus  theory  is  that,  if  you  try  to 
significantly  change  one  part,  the  sfstm  will  almoat  always  Work 
to  change  it  back  again.  In  fact,  except  in  cases  where  gradual 
but  sustained  changes  in  the^  environment  have  caused  gradual 
changea  in  a  system,  important  chang<^8\in  systems  have  not  been 
grauual,  piecemeal  developments;  rather?  each  has  taken  the  form  of 
a  "quantum  leap",  followed  by  gradual  fine- tuning. 27  Therefore, 
if  we  want  aiignif leant  Improvanent  in  put^lc  education,  gradual, 
piecemeal  modifications  of  the  structure  of  the  present  ^^stem 
will  not  achieve  the  desir^  result.  We  need  to  develop  an 
alternative  syatm  with  a  comprehensively  different  structure  —  a 
quantum  leap.  The  alternative  system  would  then  slowly  and 
gradually  be  adopted  by  school  districts  across  the  country 
perhaps  often  as  a  single  alternative  Ichool  within  a  district  ~ 
as  it  became  evident  that  the  new  structure  would  be  better  for 
that  community's  needs. 

The   following   is   an  outline  of  a  strategy  for  facilitating 
this  gradual  transition  to  a  third-wave  educational  ^stem. 

A  strategy         Slgntftoanf:  MlfijBi^pnal  Imtyovemenfc 

The  airplane  represents  a  quantum  leap  over  the  railroad  in 
^long-distance  transportation.  And  just  as  a  batter  Iqi^g-di stance 
transportation  system  (the  airplane)  was  planned,  developed,  and 
gradually  implemented  and  Improved  over  a  significant  period  of 
time,  so  also  a  better  educational  system  can  be  planned, 
developed,  and  gradually  Introduced  and  Improved  over  a 
significant  period  of  time.  In  fact,  any  attempt  to  achieve 
widespread  adoptioi-  of  any  significant  innovation  within  a  short 
period  of  time  (such  as  ^occurred  with  Dewey's  progresslvlsm)  is 
virtually  doomed  :to  crash,  if  it  ever  gets  off  the  &-ound.  The 
necessary  training  and  coordination  simply  cannot  occur 
effectively  in  such  a  short  period  of  time,  and  the  ideas  and 
techniques  inevitably  become  perverted  and  Ineffective.  Hence, 
the  following  strategy  is  offered: 

fhase  !•  Develop  a  comprehensive  bluei^lnt  f /r  lan  "ideal" 
thl.»?d-wave  educational  ^stem,  with  constdera:  i  e  input  frcm 
educational  analysts,  practitioners,  reformers^  parent^,  and 
students.  to  the  extent  that  it  ir  cost-effective,  conduct 
research  and  field  tests  on  parts  of  the  ^stem  to  Improve 
(replace,    modify,    or.  supplement)  them  as  much  as  possible  before 
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lBpl6Mntatlon  of  the  first  prototype. 

Jbaa&  Secure  funding  from  private  and  governDent  sources 
to  ittplenent  a  prototype. 

iliaaft  !•  Idettniy  the  com-^unltgr  for  Implementing  the  first 
prototypei  perhaps  a  new  communitgr  that  will  be  starting  up  a 
public  school  system,  or  perhaps  a  large  city  district  In  which 
the  new  system  would  function  as  an  "alternative  school «  within 
the  current  ^stem. 

fhaiSt^  A.>  Select  or  develop  necessary  instructional  reset,  oes 
(described  later),  train  personnel,  buUd  or  remodel  facilities  in 
the  selected  communis,  etc. 

ihaas  2.*  Open  the  ^ototype  school  and  constantly  monitor 
and  revise  the  various  aspects  of  the  system  until  It  operates 
effectively  and  asioothly. 

JEbasft  Build   an   Institute  to  publicize  results  of  the 

qrstem,  facilitate  its  adoption  by  Interested  school  districts, 
train  personnel,  (and  train  schools  of  education  to  train 
personnel),  accredit  schools  (but  this  accreditation  would 
supplement  rather  than  replace  state  accreditation),  monitor  and 
dlsacoredlt  schools,  develop  additional  educational  resources,  and 
so  forth. 

.  Adopt-^' on  would  be  a  local-school-district  decision,  and  there 
would  be  severe  limits  on  the  number  of  neK  ^stems  that  could  be 
implemented  each  year,  because  of  the  traialhg  and  "retool ing** 
requirements  that  could  realistically  be  handled  by  the  Institute. 
Within  -10  years  of  the  implementation  of  the  prototype  school,  it 
is  likely  that  fewer  than  five  per  cent  of  the  nation's  public 
school  districts  would  have  changed  to  the  nm  structure.  The 
limitation  Is  not  so  much  one  of  expense,  for  we  do  not  anticipate 
that  teacher  training  would  be  any  more  expensive  than  it  is  at 
present,  nor  would  the  buildings  and  resources  be  any  more 
expensive.  Rather  the  limitation  is  one  of  expertise.  It  will 
take  t<me  for  schools  of  education  to  learn  how  to  train  the  new 
type  of  teachers.  Hence,  the  new  system  w'.ll  be  equally 
affordable  for  rich  and  poor  districts  alike.  In  fact,  it  seems 
plausible  that  the  districts  which  are  having  the  most  trouble 
will  be  the  first  to  want  to  adopt  the  new  structure  (especially 
if  outside  funds  accompany  it  for  the  first  year  or  two),  thereby 
providing  a  significant  means  for  redressing  current  inequality  of 
educational  opportunity. 

He  propose  that  this  is  a  workable  and  not  particularly 
expensive  strategy  for  implementing  a  significant  improvement  in 
public  education. 

INITIAL  PROGRESS  ON  A  BLUEFRINT 
The  remainder  of  this  paper  reports  on  seme  preliminary 
efforts  to  develop  a  blueprint  for  the  third-wave  educational 
system  (Phase  1  above/ ^  We  organized  a  small  team  of  theorists 
and  practitioners,  parents  and  teacl*ers,  to  work  for  four  months 
on  the  initial  dev^slopment  of  the  blueirint.  We  decided  to  focus 
our  attention  on  the  jatcjictural  aspects  of  an  educational  system, 
both  because  there  is  so  much  evidence  that  the  current  problems 
lie    primarily    in  the  structure  of  the  ^stem  and  because  we  feel 
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that  the  people  of  a  oomiiunity  should  decide  on  the  goals  and 
content  of  their  children's  education. 

Fj2U&d)BLtlpns 

Many  people  look  back  to  the  one-rooo  schoolhouse  with  a  good 
deal  of  longing  and  no  stalgia.  As  with  most  things  from  the  ^good 
olde  days,  the  one-rocm  schoolhouse  was  not  everything  that  ve, 
aur  parents,  or  our  grandparents  remember  it  as  being.  Ihere 
were,  however,  several  educational  advantages  that  the  one-room 
schoolhouse  had  over  our  present  schools.  The  teacher  worked 
Individually  with  most  students,  in  contrast  to  our  present 
grouiy-based  system.  Students  progressed  at  their  own  pace,  as 
opposed  to  our  current  look«-stepped  or  tracked  i^stem.  Students 
were  not  promoted  to  learn  new  skills  and  knowledge  until  th^  had 
mastered  the  current  ones  (nor  were  they  held  back  once  they  had 
already  mastered  the  current  ones),  in  contrast  to  our  present 
time-*oriented,  graded  system.  T^e  teacher  was  responsible  for  the 
J2bild'  (as  opposed  to  a  content  area),  was  concerned  with  the  ichfiL^ 
child  (as  opposed  to  Just  one  aspect  of  his  or  her  Intellectual 
dovelopment) ,  and  was  often  a  partner  with  the  child's  parents  and 

thereby  responsive  to  their  desires  and  able  to  dreu  on  their 
influence. 

Also,  there  were  considerable  benefits  from  having  children 
of  a  variety  of  different  m&S.  in  the  same  room,  such  as 
opportunities  for  peer  tutoring  and  rcle  modelling.  A  teacher  was 
able  to  Work  with  each  child  over  a  pericid  of  years  and, 
tlierefore,  a  thorough  knowledge  of  each  child  anrl  a  consistency  in 
monitoring  and  follow-* through  existed  that  is  often  lacking  in 
today's  schools.  In  the  present,  second-wave  school  system,  where 
children  usually  rotate  from  one  teacher  to  another  each  day  and 
completely  change  teachers  each  year,  the  teachers  often  just 
begin  to  know  ^and  uuder stand  most  of  the  chxldren  by  the  end  of 
the  school  year.  This  results  in  many  needs  going  unnet  and  In  a 
great  deal  of  inefficiency  in  meeting  those  that  are  eventually 
met.  And  perhaps  most  important,  the  reduced  knowledge  and 
understanding  of  each  child  usually  results  in  a  great  deal  less 
caring  than  exj.sted  in  the  one-room  schoolhou;?e.  'Jhe  negative 
effects  of  this  problem  have  been  l^e  even  uore  sevjere  by  today's 
large  and  impersonal  school  envir  uinents,  which  hav  e  done  much  to 
foment  alienation  and  violence  in   ur  youth.28 

We  do  not  in  aoy  way  believe  that  a  third-wave  educational 
^stem  should  merely  be  a  one-room  schoolhouse  with  modern  paint. 
Times  and  needs  have  changed  too  much  for  that.  But  we  do  believe 
that  we  should  carefully  consider  the  positive  and  negative 
structural  charajteristics  of  our  present  and  past  gj^stems  in 
attempting  to  develop  a  structure  that  will  be  "ideal"  for  a 
third-wave  educational  system. 

.QXfiC^ew 

In  our  third-wave  educational  ^stem,  the  teacher's  i^ole  has 
changed  from  one  of  disseminating  knowledge  to  one  ^^f  motivating, 
advising,  and  managing  the  child's  learning.  Well  designed 
resources  (including  interactive  computer  and  videodisc  systems), 
peer    tutors,    projects,  and  learning  labs  are  used  to  convey  most. 
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skills  and  knowledge.  A  teacher  is  responsible  for  a  child  for  a 
period  of  three  to  five  years.  And  the  school  district  contains  a 
variety  of  small,  competing  ^'schools**  for  parents  to  choose  from 
(all  at  no  cost  to  parents,  and  with  no  power  for  angr  school  to 
turn  any  child  away,  thereby  providing  a  degree  of  diversi^  and 
simultaneously  a  degree  of  accountability  that  are  both  sorely 
lacking  in  the  present  system)  •  These  and  other  aspects  of  the 
structure  of  an  ^ideal"  education  system  are  described  next. 
Howevcis  it  is  important  to  keep  In  mxhd  that  this  blueprint  is 
not  likely  to  be  a  solution  to  all  our  nation*  s  educational 
problems.  We  hope  It  will  help  to  encourage  new  ideas  and  to 
further  developments  in  the  design  of  a  better  school  system. 

Teachers  as  Guid^^ 

Host  people  who  have  advocated  structural  reform  of  our 
schools  have  called  for  a  different  role  for  teachers,  a  role  that 
is  more  professional  and  that  relies  more  on  teclmology  to  free 
the  teacher  from  routine  tasks  and  drudgery.  Accordingly,  in  the 
third*wave  educational  system,  the  relationship  betiieen  the 
teacher  and  the  child  is  not  one  of  purveyor  'ind  receiver  of 
information.  of  all,  not  all  learning  occurs  in  schools; 

the  parents  and  the  community  are  important  sources  of  learning. 
Therefore,  one  of  the  teacher*  s  roles  is  to  orchestrate  and 
coordinate  efforts  by  parents,  community,  and  school.  Second  of 
all,  within  the  school,  most  knowledge  is  obi^eyed  through  well 
designed  resources  (including  objects,  printed  materials,  and 
interactive  computer-based  instruction),  inexpensive  assistants 
(including  apprentice  teachers,  senior  citizen  volunteers, 
I^rents,  and  peer  tutors),  projects,  discussion  groups,  learning 
TLabsT^r'e'sburce  peop7.3,  and  so  /'orth. 

Hence,  the  teacher  is  mere  a  igii^is.  than  a  teacher,  as  is  the 
case  in  the  Montessori  system,  which  has  functioned  extremely  well 
in  this  mode.  The  role  of  the  guide  is  one  of  motivating, 
advising,  and  managing  the  child,  rather  than  delivering  most  of 
the  content  knowledge.  The  guide  is  a  conductor  rather  than  a 
musician.  She  or  he  is  an  Instructional  manager  who  helps  the 
child  and  parents  decide  upon  appropriate  instructional  goals 
(within  limits)  and  then  helps  identify  and  coordinate  the  best 
mea.  i  for  ths  ahild  to  achieve  those  goals.  And  those  goals  go 
beyond  the  intelleclaal  develoFment  of  the  child;  th^y  may  extend 
to  the  child's  physical,  social,  moral  and  psychological 
development,  depending  on  the  parents*  wishes. 

Guides  work  individually  and  in  anall  groups  with  children  to 
insure  that  they  r^ch  their  goals.  Therefore,  there  is  no  such 
thing  as  a  **class"  in  the  sense  of  a  group  of  children  who  learn 
the  same  material  in  the  same  place  at  the  same  time  for  a  whole 
term  or  academic  year.  (There  are,  however,  occasional  discussion 
groups  and  seminars,  wliich  are  especially  useful  in  such  areas  as 
literature;  and  some  inini-courses  utilize  class  meetings  when 
better- alternatives  are  not  available.)  Each  child  has  individual 
educational  goals  and  could  be  matched  to  a  unique  combination  of 
resources  with  the  help  xOf  a  computer-abased  advisement  and 
management  ;^stem.  The^  cosv->effectiveness  of  this  system  is  very 
premising  and  is  discussed  later. 
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DjBXfiLopmental  Lw#la  a>a  ^'Grada  Level  aw 

In  the  third-vave  aobool  ayatm  a  guide  Is  responsible  for 
each  of  his  or  her  students  for  one  of  the  developmental  stages  of 
the  child's  life:  a  period  of  approxiaately  3  to  5  years.  On  the 
basis  of  work  by  Flageti  Erlksoni  f^nd  others,  we  currently 
oonoelve  of  four  stages  as  being  relevant  to  the  s^ool  system: 
approximately  ages  3  ix>  5,  6  to  9f  10  to  13y  and  1^!  to  18.  The 
school  organization  is  structured  around  these  four  levels, 
enabling  each  guide  to  work  with  a  child  for  an  average  of  four 
years.  Either  the  parents  or  the  guide  can  request  a  change 
before  the  child  has  entered  the  next  developmental  level,  but 
there  is  a  ^test  period^  of,  say,  6  months  during  which  no  changes 
are  allowed.  The  process  whereby  parents  request  a  guide  is 
described  next. 

^USRtfl  Chooae  Guides 

Parents  request  a  guide  for  each  of  their  children.  Cn  the 
basis  of  information  made  available  by  an  independent  ^consumer 
reports^  type  of  district  office  and  on  the  basis  of  word  of  mouth 
and  interviews  with  guides,  the  parents  request  in  order  of 
preference  about  three  to  five  guides  (depending  on  the  size  of 
the  school  district).  The  **consumer  aid**  office  also  provides 
diagnostic  testing  and  interviews  to  help  parents  make  the  best 
decision,  or  to'make  it  for  them  If  th^  are  not  interested.  Each 
guide  decides  how  many  children  to  accept  each  year,  but  does  not 
decide  which  children  to  accept  —  that  is  decided  by  a  formula 
that  maximizes  the  number  of  first  choices  filled  di strict-wide 


JlCiUfl.t.ers'*       Independent  Schools 

In  other  professions  like  medicine  and  law,  {professionals 
often  work  together  rather  than  independently;  and,  unlike 
teachers,  they  maintain  a  high  degree  of  decision-making 
participation  in,  and  control  over,  the  organization.  In  a 
similar  way,  even  though  parents  choose  an  individual  guide,  that 
guide  does  not  work  independently,  but  is  a  member  of  a  ^'cluster" 
of  guides.  A  cluster  usually  consists  of  about  3  to  6  guides, 
their  assistants,  their  students,  and  a  leader,  who  is  a  faster 
guide". 

Like  a  lawyer  in  a  law  firm,  each  guide  has  considerable 
responsibility  for  the  success  of  the  cluster,  aq^  considerable 
incentive  to  meet  that  responsibility  (see  next  paragraph) i  and 
considerable  power  to  meet  that  responsibility.  In  the  present 
^stem,  teachers  are  given  the  first  but  not  the  last  twol  Is  it 
any  wonder  that  the  structure  works  against  good  .^^esults!  Just  as 
the  ^^administrator**  of  a  law  firm  is  a  practicing  lawyer,  so  the 
Bastcr  £Ui$i&  is  an  active  teacher.  But  the  master  guide  also  has 
a  variety  of  other  responsibilities,  foremost  of  wK  ^  is 
instructional  leadership  for  the  duster.  Ultimately,  the  master 
guide  has  the  major  responsibility  for  the  success  of  the  cluster. 


XoSfijti'tlves  aq^i  Rewards 

The   cluster*  s    success   depends  on  how  satisfied  the  parents 
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and  ohildrtn  beoause  its  inoome  depends  in  pert;  on  the  nuaber 
of  flretf  aeoondy  and  third  ohoioe  request  a  for  all  of  ita  guldea. 
But  it  ia  the  inooae.  of  each  oluat^  that  dependa  on  deaand  for 
ita  guidea,  not  the  inoome  of  each  gitide  dlreotly«  A  guide^a 
aalary  ia  baaed  only  on  the  number  of  atudenta  he  or  abe  haa  and 
the  ol  uater^  a  groaa  inoone.  Hence,  there  ia  oonalderable 
incentive  to  help  aqy  guidea  in  the  cluater  who  are  not  doing 
well*  Ihia  reaulta  in  a  nice  combination  of  iiomnetltion  between 
cluatera  (providing  incentive  for  excellence  and  reaponaiveneaa  to 
the  oommunity^a  diverae  dealrea  and  needa)  and  .QasjBar.itticii  within 
each  cluater  (providing  aupport  and  encouragement  among  guidea), 
not  unlike  that  diaracteriaing  moat  other  profeaalona* 

With  reapect  to  jxaiietition.  the  dependence  of  cluater  income 
on  parental  aatLafaction  makea  guidea  very  accountable  for  what 
they  do  or  don!t  do*  If  a  cluater  la  doing  a  bad  Job  of  meeting 
parental  expectationai  ita  inoome  will  fall,  aa  will  the  income 
for  all  of  ita  guidea.  With  reapect  to  sQasifir»XiSak  within  each 
cluater,  the  fact  that  a  guide^a  income  dependa  not  only  on  hia  or 
her  own  efforts,  but  alao  on  the  aucceaa  of  the  other  guidea  in 
the  cluater  reaulta  in  a  muct  greater  incentive  to  cooperate  and 
help  each  other  to  insure  that  all  the  cluater^s  children  do  as 
well  as  they  can. 

Learning  Labs 

In  the  fields  of  law,  accounting,  and  medicine,  the  general 
practitioner  has  access  to  specialists  in  different  areas.  In  a 
similar  way,  the  guide  has  eocess  to  various  learning  labs.  A 
learning  lab  provides  instruction  In  a  specific  subject  area.  It 
can  be  a  traditional,  dlacipline-orlented  area  such  as  biology  or 
a  cross-disciplinary,  problem-oriented  area  such  as  pollution. 
These  learning  labs  -operate  completely  independently  of  the 
clusters. 

All  children  in  the  school  district  receive  a  certain  number 
of  tickets  or  passes  that  entitle  them  to  use  the  learning  labs. 
The  labs  in  turn  receive  their  budgets  on  the  basis  of  the  number 
of  passes  that  they  collect,  so  there  ia  considerable  incentive  to 
attract  stuc^ents  and  satisfy  cluster  guides^  needs.  Again  there 
Is  a  nice  combination  of  competition  between  labs  and  cooperation 
within  a  lab.  We  currently  envision  three  types  of  learning  labs: 
^shopping  mall**  labs,  site  labs,  and  mobile  labs.  Diey  are 
described  in  some  detail  later. 

In  summary,  the  major  aspects  we  currently  envision  for  the 
third-^wave  educational  i^ystem  are  the  following: 

1.  Teachers  are  guides  who,  in  cooperation  with  the  child's 
parents,  motivate,  adviae,  and  manage  a  child's  education  for 
3  to  5  years. 

2.  Resources  (including  well-dedgned  materials,  peer  tutors, 
projects,  discussion  groups,  learning  labs,  and  resource 
I>eople)  are  used  to  effect  most  of  the  learning. 

3.  There  are  no  traditional  ''classes**,  but  each  child  has 
individual  goals,  and  a  unique  combination  of  resources  and 
approaches  is  prescribed  to  reach  those  goals. 

4.  Guides  work   cooperatively   within  an  educational  cluster  with 
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about  2  to  5  other  guldesi  inoluding  a  Msttr  guide* 
5«  lilt  Msttr  guide  aeta  the  achool  oliaate  and  philoaophy,  hirea 
goldea  and  aaaistanta,  providea  proraaaloDi:^  development  for 
goidea  and  aaaiatantai  and  providea  direotior  and  leaderahip 
for  the  whole  oluater* 
6«  After  a  trial  period,  parenta  are  free  to  requoat  to  aove  their 
child  to  anothe^  available  guide  and  oluater  if  th«gr  are  not 
aatiafif^  with  their  child*  a  progreaa«  Hence,  individual 
guided  and  oXuatera  are  very  accountable  for  vhat  they  do  or 
don^t  do,  and  they  have  conaLderaULe  incentive  to  work  with 
parenta* 

7«  Guidea  have  a  grert  financial  incentive  to  cooperate  and  work 

together  for  the  aupceaa  of  the  whole  cluater« 
8«  Guidea  can   send  children  to  learnicf;:  laba  of  varioua  kinda  to 

receive  the  beat  available  inatruction  on  aelected  au6Jecta« 
The  following  ia  a  ncre  detailed  deaoription  of  the  varioua 
aapecta  of  the  atructure  of  thia  third-wave  educational  syatm. 

Xtluaiflxi  ilfifiCAUoQa 
Since   the  guide  ia  the  hub  of  thia  educatlvonal  univerae,  we 

ahall  further  deacrlbe  the  atrucv-ure  of  the  ayatem  on  that  level* 
Aa  waa  nentioned  above,  every  ^^lide  auat  belong  to  a  oluater, 
which  ia  much  like  a  nail. law  firm  or  medical  clinic*  Alao,  a 
^ide  ia  reaponaible  for  children  for  one  complete  level  of 
development  (approximately  four  yeara)^  In  an  exceptional  caae,  a 
guide  might  prefer  that  hia  or  her  atude.nta  be  apread  out  ove;.^  two 
or  even  three  levela  rather  than  juat  ^ne«  In  auch  caaea  it  is 
probably  advisable  that  children  switch  to  a  different  guide  upon 
tranaiti.onlng    o  the  next  level* 

Each  guide  of  en  uses  apprenticea,  (training  to  become 
guidea),  advanced  atudents,  and  volunteera  (including  parents, 
aenior  citizena,  and  other  members  of  the  community)  aa  v^aaiatants 
to  help  teach  his  or  her  students*  Many  receive  credits  for  their 
services  rather  than  money*  Those  credits  entitle  th«  to 
personal  use  of  the  learning  laba  for  continuing  education  or  the 
child  care  cenl;jf/r  for  care  of  their  own  children*  Ttitoring  i3 
also  a  valuable  experience  for  students*  Ihere  is  an  apt  addage 
that  goes,  ^Tti^\  best  way  to  learn  something  is  to  teach  it,**  and 
indeed  I  feel  tiiat  1  learned  more  about  Economica  in  one  year  of 
teaching  it  in  hi^  adiool  than  in  three  yeara  ^^f  majoring  in  it 
in  college*  Studenta  are  a  very  much  overlooked  resource  that  can 
save  a  achool  system  much  mcj^iey.  Improve  learning,  and  result  in 
even  greater  benefits  for  the  tutors*  But  they  must  have  proper 
training  and  guidance  to  be  most  effective*29 

At  this  point,  our  best  guess  is  that  in  L  jvel  1  (ages  3  to 
5)  each  guide  is  responsible  for  about  25  children,  in  Level  2 
(ages  6  to  9)  about  35  children,  in  Level  3  Uges  10  to  13)  about 
45  chlli^^r^n,  and  in  Level  4  (ages  14  to  18)  about  55  children. 
These  differentials  reflect  the  increased  use  of  learning  labs  as 
the  age  level  increases*  Alao,  keep  in  mind  that  the  services  of 
apprenticea,  advanced  atudents  and  volunteers  considerably 
listens,  the  load  of  each  guide*  However,  we  must  caution  that 
these  figures  are  our  best  guess  at  present,  and  experience  cay 
reveal  better  figures* 
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AlaOf  as  nentioned  earliart  each  guide  decides  heir  man;^ 
diildren  to  accept;  that  is,  what  portion  of  a  ^'full  load''  to 
accept*  The  importance  of  parent  satisfaction  keeps  this  figure 
trm  becoming  too  large,  and  the  guldens  personal  inoome  needs 
keep  it  from  being  too  mall.  But  if  a  guide  wants  to  work  half 
time  on,  say,  writing  a  book  or  computer  program,  then  he  or  she 
can  do  so  by  accepting  fewer  students  (and  receiving  a  lower 
inccmie). 

Aoywhere  from  about  3  to  6  guides  can  c<»Dprise  a  duster. 
With  4  guides  in  each  cluster,  there  would  b^  one  guide  on  each 
of  the  four  developnental  levels,  assuming  that  the  cluster  elects 
to  serve  all  four  levels.  Such  a  cluster  would  have  about  160 
children  siread  out  over  the  ages  of  3  to  18«  This  means  that 
there  would  be  an  aver^'gn  of  about  10  children  of  any  given  age 
within  the  cluster*  If  the  cluster  serves  only  two  developmental 
levels,  there  would  be  an  average  of  about  20  children  of  arty 
given  age  within  the  duster.  Ibis  size  allows  the  children  to 
get  to  know  most  other  students  in  the  duster  fairly  well, 
resulting  in  a  more  friendy  and  caring  environment  and  more 
cross-age  interaction. 

£EfiSif  ics  JiaL  Ifijtgl 

In  JUfiZfiL  1  the  guides  are  very  similar  to  Montessori 
teachers. 30  They  introduce  children  to  wdl«-designed  educational 
resources  as  the  chlliS?^en  become  ready  for  them,  and  the  resources 
do  most  of  the  teaching  of  knowledge  and  skills.  The  guides  also 
arrange  activities  that  hdp  develop  the  child  socidly, 
emotlondly,  and  physicdly  (motor  coordination).  Children  are 
exposed  to  a  variable  environment  in  which  caring  guides  and 
assistants  nurture  their  development  and  encourage  them  to 
alternate  regularly  between  learning  act5.vity  and  socid 
interaction,  free  play,  exercise,  and/or  rest. 

Most  learning  at  this  level  takes  place  within  appropriate 
cluster  facilities,  but  fidd  trips  are  occasiondly  taken  so  that 
the  outdde  environment  can  influence  the  children's  development. 
Mobile  labs  (discussed  in  the  next  section)  and  other  outsiders 
(including  parents)  occasiondly  come  and  put  on  a  program  to 
enrich  hcme-^room  activities. 

Parents  can  leave  thdr  child  in  the  cluster  facility  as  long 
as  they  wish,  but  there  is  a  charge  if  the  child  is  left  for  more 
than  six  hours  per  day.  This  charge  can  be  paid  in  money  or  in 
time  contributed  to  the  cluster.  The  more  advanced  children 
occasiondly  participate  in  activities  in  a  Level  II  group.  This 
facilitates  their  transition  into  the  next  levd  with  a  minimum  of 
anxiety  (even  if  the  child  advances  to  a  different  cluster).  The 
timing  of  the  fdl  "graduation''  to  the  next  level  is  made  in 
consdtation  with  the  parents  and  is  based  on  a  combination  of  the 
child's  intellectual,  socid,  and  emotiond  development,  including 
levd  of  learning  skills  and  degree  of  self«*directedness  and 
responsibility. 

In  LfiifiL  iL.  the  opposite  end  of  the  devdopmentd  spectrum, 
the  cluster  facility  is  more  of  a  conference  room  than  a  home  room 
and  activity  room.  Almost  dl  content  learning  occurs  in  the 
learning     labs,     indudlng     lab-sponsored    seminars,  projects, 
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tutoring  aeAslona,  and  ao  forth.  Alao,  Intellectual  aoavenger 
hunta  entailing  interdiaolplinary  problem  aolving  are  widely  uaed. 
Guidea  apend  much  time  monitoring  and  motivating  the  children  and 
juat  plain  caring.  Mich  time  ia  alao  apent  in  individual 
converaationai  for  the  guide  ia  more  a  counaellor  (an  educator  in 
the  true  aenae  of  the  word)  than  ^  teacher.  In  the  domain  of 
cognitive  developmenti  thoae  converaations  are  often  directed  at 
hither  levels  of  knowledgei  including  synthesis  and  evaluation  in 
Bloom*  a  taxonomy3l  and  cognitive  strategiea  (or  generic  skills)  in 
Gagne^s  taxonGmy.32  Service  projecta  are  often  required  of 
students. 

The  guide  alao  worka  closely  with  the  parents  on  such  other 
concerns  as  the  child*  s  emotional t  sociali  artistic,  mc»?al,  and 
p^chological  development.  This  entails  (1)  identifying  with  the 
parents  any  aspects  of  development  that  need  work  or  any  obstacles 
to  further  development  that  need  to  be  removed,  and  (2)  developing 
an  appropriate  plan  that  entails  certain  parental  actions  as  well 
as  certain  guide  actions  of  which  the  parents  approve.  As  parents 
who  have  occaaionally  felt  as  if  we  were  at  our  rope*s  end  with 
one   of   our   children,    we   feel    it  should  also  entail  providing 

advice  when  deaired  by  the  parents  on  how  to  handle  behavior 
problems  and  how  in  general  to  increase  the  quality  of  home  life. 

On  the  intsrvening  levels  (II  and  III),  the  guides  serve  both 
roles  described  above  (for  Levels  I  and  IV}.  The  degree  to  which 
each  role  is  played  the  guide  progresses  as  the  child  develops 
from  a  Level  I  person  to  a  Level  IV  person. 

At  whatever  level,  each  guide  must  abide  by  a  ^^renaissance 
approach**  that  establishes  certain  minimum  levels  of  development 
in  each  of  a  broad  range  of  basic  areas  (including  basic  skills). 
I  have  wonderful  memories  of  a  summer  camp  in  which  we  campers 
were  allowed  to  go  to  whatever  activity  we  wanted  whenever  we 
wanted.  lliere  was  a  big  chart  on  which  achievements  in  each 
activity  were  posted  for  each  camper,  and  we  had  to  progress  by  at 
least  one  level  of  achievement  in  each  activity  every  week.  That 
way,  when  we  went  to  do  an  activity  that  we  dldnH  particularly 
like,  we  decided  when  to  do  it  and  we  were  motivated  to  get  it 
done.  And  of  course  we  all  tended  to  far  exceed  the  one-level 
minimum  in  activities  that  we  liked.  Also  there  were  points  given 
for  each  achievement,  and  campers  were  members  of  teams  that 
competeo  to  get  the  hi^est  number  of  team  points. 

Similarly,  in  our  **ideal**  educational  system,  as  long  as  the 
minimum  levels  of  achievement  are  met  in  all  areast  the  children 
can  study  whatever  they  want  whenever  th^  want*  As  might  be 
expected,  the  yearly  and  quarterly  minimum  levels  vary  depending 
on  the  general  ability  level  of  the  child.  For  example,  a  child 
with  an  IQ  of  50  is  not  expected  to  achieve  the  same  minimum 
levels  as  one  with  an  IQ  of  150.  Benjamin  Bloom  has  evidence  to 
suggest  that  the  differences  in  rate  of  learning  that  currently 
exist  in  our  schools  are  more  a  function  of  differences  in 
accumulated  skill  and  knowledge  deficiencies  than  of  differences 
in  ^^intelligence**  per  se.33  The  emjAiasis  is  on  each  child 
achieving  according  to  his  or  her  potential.  For  **late  bloomers** 
the  minimum  levels  are  adjusted  to  represent  relatively  larger 
steps. 
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The  guide  aalntains  an  aohlwenent  profile  on  each  of  his  or 
her  students  on  a  oonputer-baaed  advisement  and  management  system. 
Grades  are  not  given,  because  in  an  Information  society,  a  profile 
of  the  kinds  of  abilities  and  knowledge  one  has  is  more  important 
than  a  letter  grade  or  a  general  rank  in  class* 

There  are  duster-vide  and  distriot«-vide  interest  groups  and 
clubs,  dealing  with  such  interests  as  computers,  drama, 
photography,  voodirorking,  music,  chess,  dance,  etc*  There  are 
also  duster-vide  and  district-vide  social  events  and  athletic 
events*  A  major  benefit  of  this  structure  is  a  much  hi^er  rate 
of  student  partiLoipation  in  athletics  and  other  interests* 
Opportunities  for  leadership  and  exercise  of  responsibility  are 
also  increased*34  Volunteers  (parents,  senior  citizens,  and  other 
community  members)  and  older  students  do  much  of  the  supervision, 
much  as  is  presently  done  vith  Little  League  baseball  and  Scout 
programs* 

Learning  Lqbs 

It  vas  mentioned  earlier  that  learning  labs  provide 
specialized  expertise  on  different  subject  areas;  and  ve  have 
recently  seen  that  the  older  the  child,  the  more  the  labs  are 
used«  A     learning     lab     can     be     for     a  traditional, 

discipline-oriented  area  such  as  biology  or  for  a 
cross-disciplinary,  problem-oriented  area  such  as  pollution;  and 
it  can  bo  for  an  intellectual  area  such  as  philosophy  or  for  a 
technical  area  such  as  automobile  maintenance  and  repair*  In  all 
cases,  labs  vould  be  encouraged  to  Incorporate  instruction  in 
thinking  skills  and  other  higher-order  skills  into  the  content 
area  instruction,  and  guides  vould  be  responsible  for  helping  the 
student  to  put  together  a  program  of  study  that  represents  a  good 
progression  of  such  higher-order  skills  instruction*  Resources 
are  allocated  to  the  labs  on  the  basis  of  their  usage,  providing  a 
combination  of  cooperation  and  competition  similar  to  that  for  the 
clusters* 

We  mentioned  earlier  that  there  are  three  types  of  learning 
labs:  mobile  labs,  "'shopping  mall"  labs,  and  site  labs*  The 
msiZLLe  labs  are  labs  on  vbeels  that  travd  around  from  one  duster 
to  another  and  even  from  one  district  to  another*  The  ahopping 
mall  labs  are  centrally  located  labs  to  vbich  the  children  in  a 
district  go*  Ihey  range  from  a  one- room,  one- person  (part/* time) 
•^craft  c'uop"  cperation  to  a  nation-vide  operation  (the  Sears  of 
the  shopping  mall  labs)*  There  tends  to  be  continuous  (although 
not  too  frequent)  turnover  as  the  "offerings'*  adjust  to  changing 
times  and  changing  demands*  Also,  there  are  cooperative 
arrangements  vhereby  children  may  use  labs  located  in  another 
school  district*  The  site  labs  are  located  at  the  part-time 
organizations  vhich  sponsor  them,  such  as  museums  and  businesses* 
Tax  vrite-offs  are  an  important  incentive  for  the  creation  of  such 
labs« 

All  learning  labs  must  be  approved  and  periodically 
recertified  by  the  school  district's  Lab  Management  Organization 
(described  later)*  Learning  labs  can  be  started  by  almost  anyone 
in  any  subject  area,  including  cross-disciplinary  areas,  but 
certain   training   and   standards  (especially  regarding  character) 
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are  required*  A  learning  lab  director  runs  the  lab;  and  depending 
on  the  nature  of  the  lab,  the  director  finds  out  about  and  makes 
available  top-quali^  resources,  plans  good  actlYitieSt  makes 
arrangeaents  for  coamuni^«»based  experiences,  hires,  trains  and 
monitors  assistants  (apprentices,  advanced  students,  parents,  and 
other  members  of  the  community)  to  help  teach,  and/or  Interacts 
personally  with  children  to  motivate,  advise,  and  manage  their 
learning  within  that  specialty  area«  Teachers  refer  their 
students  to  specific  learning  labs  and  even  to  specific  personnel 
in  a  learning  lab*  Many  learning  labs  are  run  by  part-time 
amateur/hobbyists  and  retired  people  at  very  little  expense  to  the 
school  district* 

Logistlcally,  the  shopping  mall  labs  would  likely  be  located 
at  the  ^ub  of  a  wheel*'  in  which  the  clusters  are  located  in 
separate  buildings  out  on  the  ^rim,^  attached  by  enclosed  walkways 
( ^'spokes")  *  Ibis  arrangement  would  eliminate  the  need  for 
transportation  and  would  allow  for  district  facilities  such  as 
library,  auditoi*lum,  child<-care  facilities,  and  food  services  to 
be  easily  accessible  to  all  clusters,  while  still  maintaining  sane 
physical     separateness     for     each     cluster*       (Althou^  food 

preparation  could  be  done  centrally,  each  cluster  should  ha\re  its 
own  cafeteria  to  help  build  cluster  cohesion*)  Very  large 
districts  might  have  several  such  ^fheels^^  at  different  locations 
within  the  district*  Although  such  a  logistical  arrangement  might 
be  ideal,  existing  school  buildings  could  be  utilized  with 
relatively  few  modifications  to  meet  the  same  needs* 

USSL  the  Student  Uaea  tl^e  Lrjarning  Labs 

At  the  beginning  of  each  quarter  (three  month  period),  each 
student  in  the  district  is  awarded  a  certain  number'  of  learning 
lab  passes*  The  exact  number  depends  on  the  child's  level  of 
Intellectual  development  ~  the  higher  the  development,  the  more 
passes  awarded*  Also,  each  child  can  earn  additional  passes 
through  such  activities  as  tutoring,  helping  with  the  preparation 
of  displays  and  materials,  supervising  extra-curricular 
activities,  etc* 

Some  of  the  passes  are  ''restricted''  passes  and  some  are 
"open"  passes*  The  r.fia£r:lcted  josLS^s  must  be  used  for  the  study 
of  skills  and  knowledge  specified  by  the  child's  "quarterly 
contract"  (see  below),  whereas  the  open  passes  can  be  used  to 
study  anything*  This  results  in  a  combination  of  structure  and 
flexibility  similar  to  that  of  the  summer  camp  described  earlier* 

Bach  pass  must  be  filled  out  and  signed  by  the  guide,  who 
indicates  the  lab  In'whlch  it  is  to  be  used*  This  helps  the  guide 
to  Influence  and  keep  track  of  the  child's  learning*  The  child 
hands  in  the  pass  to  the  lab,  so  that  the  lab  can  then  cash  it  in 
for  payment  from  the  discrlct  office*  The  passes  could  be 
Implemented  electronically  with  magnetic  ID  cards  and  electronic 
time  clocks  that  feed  data  on  student  and  lab  usage  into  the 
district-wide,  conputer-based,  advisement  and  management  aystem. 
Teacher  approval  would  be  entered  into  the  computer  system,  and 
the  ^stem  would  reject  any  child  who  tried  to  log  in  to  a  lab 
without  such  approval*  Each  lab  allows  each  student  a  minimum  of 
one   hour   of  free  iHjcsaLSing"  every  quarter  for  purposes  of  seeing 
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if  there  is  aiqrthlng  he  or  ahe  would  like  to  learn  in  that  lab# 
Of  course,  the  lab  receives  remuneration  from  the  school  district 
for  such  bz^oirsiQg* 

Having  a  Halted  supply  of  passes  to  use  in  a  quarter,  the 
children  are  acre  concerned  with  making  the  most  of  each  one  ~ 
that  is,  not  wasting  precious  time  ^hacking  around*"  And  having 
the  flexibility  to  study  what  th^  want  when  th^  want  (within  the 
structure  of  the  minimum  requirements  and  the  other  goals 
specified  in  each  child's  quarterly  contract)  provides  heightened 
motivation  and  increased  self-determination  and  self-management 
that  are  so  Important  in  an  information  society* 

At  the  beginning  of  each  quarter,  the  guide  sits  down  with 
each  of  his  or  her  students  and  the  student's  parents,  if 
possible^  Togethw,  th^  prepare  a  plan  or  isantraci.  for  the 
child's  learning  goals  and  activities  for  the  quarter.  Asa 
result  of  this  plan,  a  checklist  of  required  goals  and  activities 
is  prepared  (probably  with  the  help  of  the  computer-based 
advisement  and  management  ^yst^),  and  the  use  of  restricted 
passes  Is  planned*  However,  the  plan  is  devised  in  such  a  way  as 
to  leave  some  time  for  children  to  pursue  their  own  interests  with 
their  open  passes,  whose  use  Is  also  discussed  and  informally 
planned  at  the  beginning  of  each  quarter. 

The  intent  here  is  to  establish  a  balance  betoieen  structure 
and  flexibility*  Each  cluster  may  establish  its  own  policy  (or 
lack  thereof)  with  respect  to  the  balance  betwsen  requirements  and 
options,  except  that  the  district  may  establish  certain  minimum 
levels  of  davelopment  in  different  areas  for  different  age  groups 
(perhaps  adjusted  by  individual  limits  to  rate  of  development  as 
measured  by,  say,  IQ  or  some  better  indicator). 

At  this  time,  the  guide  and  parents  may  also  have  a  private 
conversation  about  any  problems  the  parents  are  having  with  the 
child  so  that  the  guide  can  give  advice  and/or  take  steps  to  help 
out»  The  guide  also  identifies  things  the  parents  can  do  or  need 
to  do  to  help  the  child  achieve  his  or  her  quarterly  goals  (not 
Just  intellectual,  but  also  emotional,  social,  artistic,  physical, 
etc.)» 

At  the  end  of  each  quarter,  the  guide  sits  down  with  each 
child  and  the  parents  (although  two  separate  meetings  would  not  be 
uncommon)  and  reviews  the  child*  s  achievements  in  relation  to  the 
contract  for  the  quarter.  Ihis  provides  part  of  the  basis  for 
planning  the  next  quarterly  contract,  which  usually  occurs  at  the 
same  session* 

Extensions  ^        Present  Svstem 

The  present  educational  ^stem  would  be  extended  in  two 
important  ways,  in  addition  to  the  concern  for  non-academic 
aspects  of  the  child's  development:  (1)  It  is  open  longer  and  (2) 
it  is  open  for  use  by  adults*  It  is  open  longer  in  three  ways. 
It  is  open  more  hours  per  day,  until,  say,  9:00  p.m.  This  is  done 
at  very  little  extra  expense  because  it  is  largely  supervised  by 
volunteer  help.  It  is  open  on  weekends,  again  at  little  extra 
expense  due  to  volunteer  help.    And  it  is  open  all  summer  long. 
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students  can  take  vacations  whenever  their  parents  want,  due 
to  the  IndiTlduallzed  structure  of  the  school*  Sinllarly,  guides 
and  staff  can  take  their  vacations  pretty  such  whenever  they  want 
because  of  the  aultlple-leveled  staffing  structure  of  the  ^stec 
(ayprentice  guides,  volunteers,  and  older  students) «  Guides  feel 
less  of  a  need  for  a  long  vacation  in  their  new  roles,  and  this 
elifflinates  the  need  for  teachers  to  find  sununer  employment  at  what 
are  often  not  very  rewarding  (professionally  or  financially)  jobs. 
Hence,  it  makes  education  a  year-round  profession,  like  law  and 
medicine,  with  flexible  opportunities  for  vactations. 

.AdUlt^s  (people  over  18  years  old)  can  buy  or  earn  passes  to 
use  the  learning  labs,  making  the  school  ^stem  a  place  where 
young  and  old  can  learn  together*  It  also  provides  an  extra 
source  of  income  and  labor  for  running  the  sdiool  system. 

i!l3^ic.t  Qrwaaigatton  juui  jkdBLioiatrative  sxskms. 
All  school  tax  revenues,  block  grants,  and  state  aid  go 
directly  to  the  school,  district  office  tor  district-wide 
distribution.  The  district  office  establishes  a  budget  for 
clusters  (probably  by  establishing  an  amount  per  pupil  and 
multiplying  by  the  number  of  pupils  anticipated  for  that  year)  and 
a  budget  for  the  Learning  Lab  Kanagement  Organization  (probably  by 
establishing  an  amount  per  pass  and  multiplying  by  the  number  of 
passes  anticipated  for  that  year).  The  budget  for  clusters  is 
alloca^*ed  to  each  cluster  in  accordance  with  the  demand  for  its 
guides.  The  budget  for  the  Learning  Lab  Management  Organization 
is  allocated  to  each  lab  in  accordance  with  th  i  number  of  passes 
it  receives,  except  that  a  certain  per  cent  is  kept  to  meet  its 
administrative  expenses.  Finally,  the  Conatmer  iii  Agency 
receives  a  flat  per  centage  of  the  total  school  district  budget 
(around  one-half  of  one  percent),  and  the  district  office  keeps  a 
flat  per  centage  for  its  administrative  expenses. 


SHiiSLer  OcsanXz^tiojl  3Bd  Administration 

A  nsSL  £lUAter  can  be  started  by  anyone  who  meets  the 
requirements,  but  a  cluster  can  be  disbanded  if  it  ever  fails  to 
meet  rainimum  standards  set  by  the  school  board  (and  individual 
personnel  can  be  "disbarred"  if  they  are  found  by  the  district 
review  board  to  be  negligently  unprofessional).  It  is  probably 
wise  to  specify  a  minimum  of  two  or  three  guides  for  forming  a 
cluster*  Training  and  certification  are  required  for  anyone  who 
wants  to  be  a  guide.  This  training  and  certification  would  be 
provided  by  schools  of  education  that  have  been  certified  by  the 
Institute.  Some  local  training  may  also  be  required  regarding  the 
district's  computer-based  advisement  and  managanent  system  and 
current  learning  labs«  The  master  guide  is  chosen  by  the  guides 
that  comprise  the  cluster,  and  a  2/3  majority  is  required  to 
replace  the  master  guide. 

For  an  established  cluster,  the  hiring  of  new  guides  is 
decided  by  a  2/3  majority  of  the  cluster's  guides.  The  firing  of 
a  guide  would  be  based  on  standards  that  are  clearly  laid  out  in 
the  charter  of  the  cluster  or  school  district  regulations,  but 
those    standards   should  allow  a  sufficient  length  of  time  for  new 
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guides  to  improve  and  for  older  guides  to  reform  their  ways* 
Because  of  the  importance  of  duster  oohealveness  and  cooperation 
among  guides,  a  simple  majority  is  sufficient  for  a  cluster's 
guides  to  decide  whether  or  not  the  criteria  for  release  have  been 
met*  There  is  no  grievance  or  appeal  procedure,  again  because  of 
the  Importance  of  cluster  coheslveness  and  cooperation  among 
guides*  There  is  no  grievance  procedure  when  a  lawyer  or  doctor 
is  kicked  out  of  a  law  firm  or  medical  clinic,  but  such  is 
extremely  rare. 

An  ^slBLlnistrative  person  from  the  district  office  is  in 
charge  of  the  accounting,  reporting,  and  logistical  aspects  for 
all  clusters  within  the  school  district,  but  the  cluster  decides 
hew  its  budget  will  be  spent*  This  frees  the  head  guide  to 
concentrate  on  instructional  concerns  and  school  climate* 

It  was  mentioned  earlier  that  each  cluster's  gross  income  is 
dependent  on  the  total  demand  for  its  guides*  A  point  system  is 
used  whereby  each  guide  receives  3  pcints  for  being  the  first 
choice  of  a  ''new'*  student,  2  points  for  being  the  second  choice, 
and  1  point  for  being  the  third  choice*  A  "new  student"  is  one 
entering  a  new  level  of  development,  one  entering  the  school 
system  for  the  first  time,  or  one  requesting  a  new  guide  after  the 
six-month  trial  period*  The  "income  rate"  for  each  cluster  is 
determined  solely  by  the  cluster's  total  points  divided  by  the 
number  of  guides  in  the  cluster*  The  cluster's  budget  is  then 
determined  by  adjusting  that  income  rate  according  to  the  average 
per  cent  of  "full  capacity"  for  its  guides  (determined  by  the 
actual  number  of  students  divided  by  the  full«*load  number  of 
students  for  each  developmental  level)*  In  turn,  the  guides' 
salaries  are  based  only  on  cluster  budget  and  individual  load  ~ 
no  aerit  ~  and  are  a  per  oent  of  the  cluster's  gross  income* 
Hence,  the  only  way  to  increase  one's  salary,  as  in  a  law  firm  or 
medical  clinic,  is  to  ir-^rease  the  demand  for  the  cluster's 
guides*  In  this  way,  there  is  a  tronendous  incentive  to  cooperate 
within  each  cluster*  All  master  guides  receive  a  fixed  salary 
supplement  set  by  the  school  board* 

It  might  be  beneficial  to  have  two  levels  of  guides  based  on 
merit,  such  that  a  beginning  guide  would  likely  not  receive  the 
same  salary  rate  as  a  veteran  guide*  However,  this  raises 
difficult  questions  as  to  who  should  make  the  promotLon  decision* 
Alternatively,  it  might  be  beneficial  to  allow  each  cluster  to  set 
its  own  salaries,  for  the  guides  will  know  4:hat  if  their  other 
budget  categories  suffer,  parents  will  be  displeased  and  the 
cluster's  points  and  budget  for  the  next  year  will  be  lower* 
Some  districts  may  also  want  to  allocate  a  certain  fixed 
dollar  amount  per  student  to  each  cluster's  budget,  to  partially 
even  out  the  expenditures  per  student  across  clusters*  However, 
it  should  be  understood  that  the  more  the  cluster  (and  lab) 
budgets  are  influenced  by  demand  for  them,  the  easier  It  will  be 
for  superior  ones  to  grow  and  thereby  offer  a  better  education  to 
more  students  in  the  district*  It  will  also  be  less  necessary  for 
the  district  office  to  close  down  weak  clusters  (or  labs)  by 
executive  mandate,  which  Is  likely  to  be  politically  difficult,  if 
not  impossible*  This  will  be  less  necessary  because  insufficient 
personal    incomes  will  lead  the  guides  in  less  successful  clusters 
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to  seek  aore  luoratlve  poaLtions  on  their  own  initiative.  In  the 
long  run  the  oonmunity  will  be  better  off  by  regarding  excellence 
and  not  encouraging  mediocrity  to  linger  on« 

i4sacii;L.ng  lAb  MaaaKwaent  .QcganUAUPn 

There  is  a  Learning  Lab  Managenent  Organization  which  has 
the  following  reaponaibilitiea: 

0  It  surveys  the  needs  of  the  clusters  for  external  instructional 
support  (from  labs)  and  prioritizes  those  needs* 

e  It  contracts  new  learning  labs*  These  may  be  (1)  part-time 
individuals  (e.g.^  a  retired  biologist  who  lives  in  the 
community  and  is  willing  to  devote  a  part  of  her  time  to  the 
school  district) I  (2)  par^time  organizations  (e«g«,  a  local 
museum  or  business  which  is  willing  to  devote  a  part  of  its  time 
to  the  school  district),  (3)  full<-t5.me  individuals  (e.g.,  a 
mechanic  who  would  like  to  quit  his  Job  and  work  full->time  with 
kids),  and  (4)  full-time  organizations  (e«g«,  a  publishing 
company  that  has  establishod  a  subsidiary  for  running  learning 
labs  in  schools  across  the  country)* 

e  It  trains  lab  directors  whenever  necessary,  and  it  provides 
professional  development  support  servicer  to  the  labs  upon 
request* 

6  It  distributes  money  to  the  labs  according  to  the  amount  that 
each  lab  is  used. 

An  jL£bltiQlAtr.ai;ix£  person  in  the  district  office  is 
responsible  for  the  accounting,  reporting,  and  logistical  aspects 
for  all  labs  within  the  school  district,  but  again  each  lab 
decides  hew  its  budget  will  be  spent* 

Consumer  Aid  Agengy 

The  district-wide  Consumer  Aid  Agency  which  was  mentioned 
earlier  serves  (1)  as  a  placement  counseling  service  for  matching 
children  with  guides  and  (2)  as  a  watchdog  service  for  providing 
^consumer  reports**  on  clustersy  guides,  and  learning  labs 
(explained  below)*  Itiis  Consuser  Aid  Agency  is  run  by  parents 
(many  on  a  volunteer  basis)  but  receives  a  permanent  fixed  budget 
(something  like  one-half  of  one  percent  of  the  total  district 
budget)  as  part  of  a  astern  of  **checks  and  balances*** 

The  Consumer  Aid  Agency »s  CQunaelliyig  flervice  helps  parents 
to  decide  which  guide  will  be  best  for  their  child*  It  maintains 
extensive  data  on  each  guide's  characteristics  and 
accomplishmentst  and  it  diagnoses  a  child's  needs  if  parents  so 
desire,  so  as  to  enable  them  to  select  the  guides  which  seem  most 
likely  to  meet  those  needs*  Such  people-categoriea  as  ^'Intuiter*' 
and  ••thinker'*  may  be  very  useful  for  part  of  this  function. 

The  Consumer  Aid  Agency's  KAlfihdog  service  has  responsibility 
for  collecting  and  disseminating  information  about  the  quality  of 
performance  of  the  clusters,  guidest  labs,  and  Lab  Management 
Organization* 

Given  that  some  parents  do  not  care  enough  to  choose  a  guide 
for  their  child,  the  placement  service  diagnoses  each  such  child*  s 
needs  and  applies  for  the  most  appropriate  guides*  However,  such 
applications  are  not  included  in  the  point  count  described  under 
"Cluster   Organization  and   Administration"   above,    to  avoid  the 
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twptation  for  dirty  politics^  Federal »  state,  and  local 
aupiAeaeiits  for  disadvantaged  ohlldren  would  be  passed  through  the 
dlstrlot  office  directly  to  the  clusters*  budgets. 

QaatL«»£frectl!KfitAaM 

No  thoroufl^  cost  analysis  has  been  performed  as  yet,  but 
preliminary  indications  are  that  this  system  would  cost 
approximately  the  same  per  student  as  our  present  system,  yet 
would  be  considerably  more  effective.  Although  guides  are  paid 
more  than  present  teachers,  their  various  assistants  (apprentice 
guides,  volunteers,  and  older  students)  cost  considerably  less. 
Their  use  enables  a  mncb  hic^er  student-guide  ratio,  but  with 
Increased  human  contact  and  caring. 

llie  learning  labs  are  the  element  which  may  most  Influence 
costs.  Ilie  number  of  labs  and  relatedly  the  number  of  passes 
provided  to  students  each  quarter  will  greatly  influence  the  cost. 
Also,  the  extent  to  which  the  labs  are  staffed  and/or  directed  by 
volunteers  or  semi* volunteers  (those  who  accept  nominal  payment  to 
supplement  retirement  or  other  income)  will  also  greatly  influence 
the  cost. 

In  a  small  school  district,  it  might  be  wise  for  each  guide 
to  also  serve  as  a  lab  director,  with  a  fewer  students  to  guide. 
We  presently  anticipate  that  this  entire  system  can  be  run  within 
present  school  budgets,  especially  given  that  local  businesses, 
foundations,  and  Individuals  would  be  conalderably  more  Inclined 
to  sponsor  learning  labs.  Including  basic-skill  and  content-area 
shopping  mall  labs,  as  well  as  more  appllcatlon->oriented  and 
problem-oriented  site  labs. 

CONCLUSION 

Much  work  needs  to  be  done  to  further  develop,  field  test, 
and  refine  this  blueprint  of  a  third-wave  educational  ^stem  to 
the  point  whe:re  we  can  begin  to  think  about  implementing  It  in  a 
pilot  school.  And  this  only  represeats  the  first  step  in  a 
^stematlc  strategy  to  make  significant  Improvements  (a  quantum 
leap)  in  our  educational  system.  Although  the  road  to  meaningful, 
structural  reform  of  public  education  Is  long  and  difficult,  we 
feel  that  the  strategy  and  approach  are  both  very  sound.  With 
persistance  and  dedication  from  a  national  coalition  of  concerned 
citizens,  we  feel  confident  that  we  can  achieve  very  significant 
Improvements.  We  would  be  Interested  In  hearing  from  anyone  who 
would  like  to  be  a  part  of  this  effort. 
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PERCEIVED  CREDIBILITY  OF  FEMALE  PEER  TALENT 


IN  THE  CONTEXT  OF  COMPUTER  INSTRUCTION 


Introduction  and  Rationale 


The  credibility  of  persons  who  deliver  Instructional  messages  is  a  key 
factor  influencing  the  effectiveness  of  media  presentations  utilized  in 
educational  settings  (Fleming  &  Levie ,  1978).    Research  in  the  field  of 
communications  indicates  that  a  receiver's  perception  of  the  speaker's 
credibility  is  almost  always  related  in  some  way  to  the  Impact  and  effectiveness 
of  the  message  (Andersen  &  Clevenger,  1963 )•    Thus,  those  designing  and  utilizing 
visual  presentations  must  concern  themselves  not  only  with  the  content  of  the 
Instructional  message  but  with  the  credibility  of  the  talent  who  appears  in  the 


Talent  credibility,  however,  is  known  to  be  affected  by  a  number  of 
variables.    These  variables  Include  characteristics  of  the  talent, 
characteristics  of  the  audience,  and  the  influence  of  the  particular  topic 
itself.    Since  an  instructional  message  is  a  "pattern  of  signs  (words  and 
pictures)  produced  for  the  purpose  of  modifying  the  cognitive,  affective,  or 
psychomotor  behavior  of  one  or  more  persons"  (Fleming  &  Levie,  1978,  p.  Ix), 
talent  chosen  to  appear  in  media  productions  should  be  most  effective  in  their  *  > 

ability  to  influence  learners  to  think,  feel,  or  behave  in  accordance  with 
specified  learning  outcomes. 

Social  learning  theory  (Bandura,  1969,  1977,  1986;  Bandura  &  Walters,  1963) 
suggests  that  visuals  can  play  a  role  in  influencing  human  behavior  as  part  of  a 
continuous  interactive  process  involving  cognition,  behavior,  and  environmental 
factors.    Observational  learning  is  a  key  component  Involved  in  the  social 
learning  process  and  is  defined  as  the  "tendency  for  a  person  to  reproduce  the 
actions,  attitudes,  or  emotional  responses  exhibited  by  real-life  or  symbolized 
models"  (Bandura  &  Walters,  1963,  p.  89).    Learning  is  considered  to  occur 
through  the  observation  of  symbolized  models,  such  as  those  appearing  in  visual 
presentations,  and  social  learning  theory  emphasizes  the  importance  of  utilizing 
models  who  will  be  viewed  as  credible  by  the  intended  audience.    Bandura  (1969, 
1977,  1986)  further  indicates  that  learner  characteristics  will  Influence  the 
efficacy  of  any  given  model  for  any  given  group  of  observers.  Additionally, 
Bandura  suggests  that  the  context  in  which  the  models  appear  will  influence 
observational  learning.    Thus,  a  particular  model's  credibility  may  vary, 
depending  on  characteristics  of  the  model,  the  audience,  and  the  topic. 

Selecting  credible  talent  to  appear  in  instructional  media  productions  on 
the  topic  of  computers  and  computer  utilization  is  a  challenge  for  persons 
interested  in  designing,  producing,  and  utilizing  media  presentations  for 
adolescent  learners.    Numerous  articles  in  the  popular  press  (Elmer-DeWitt,  1986; 
Horn,  1985;  Sealfon,  1986)  as  well  as  entire  special  issues  of  professional 
journals  (Lockheed,  1985a;  Moursund,  1984)  have  noted  an  emerging  gender  gap  in 
computer  utilization  between  female  and  male  learners  which  becomes  most  apparent 
around  the  time  of  adolescence.    The  gender  gap  is  manifested  in  areas  such  as 
enrollments  in  computer  literacy  and  programming  classes,  attendance  at  computer 
camps,  home  use  of  computers,  elective  time  spent  in  computer  activities,  and 
level  of  elective  computer  instruction  attained^    The  concern  exists  that 
secondary  school  student3  are  perceiving  computer  use  as  a  primarily  male  domain 
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and  that  capable  females  are  self-selecting  out  of  computer  courses  and  computer 
related  activities*    The  sex-typing  of  computer  use  as  an  activity  inappropriate 
for  adolescent  females  is  believed  to  reduce  females*  potential  for  achievement 
in  computer-related  studies  and  associated  careers  (Jones,  1983;  Moursund,  1984 )• 

A  proposed  educational  intervention  to  encourage  adolescent  females  to 
participate  in  computer  activities  is  to  present  computer-using  female  models  in 
both  live  and  mediated  observational  learning  situations •    Research  on  the  impact 
of  gender  characteristics  of  instructional  materials  (Schau  &  Scott,  1984;  Scott 
and  Schau,  1985)  indicates  that  instructional  media  can  either  restrict  or 
broaden  pupils*  attitudes  aoout  who  can  or  should  participate  in  activities  which 
ar^  represented  in  media  presentations*    Investigation  of  ways  in  which 
instructional  media  productions  can  be  designed  to  encourage  young  females  as 
well  as  young  males  to  learn  about  and  utilize  computers  is  justified*  The 
selection  of  credible  talent  chosen  to  appear  in  such  instructional  media 
presentations  is  an  integral  part  of  this  endeavor* 


In  selecting  credible  talent  to  serve  as  models  for  observational  learning 
in  the  context  of  computer  instruction,  characteristics  of  the  talent, 
characteristics  of  the  learners,  and  the  influence  of  the  topic  itself  again 
emerge  as  primary  considerations*    Factors  relating  to  the  characteristics  of  the 
learners  and  to  the  characteristics  of  the  talent  which  may  affect  the 
credibility  of  the  talent  include  the  age  and  gender  of  both  the  observer  and  the 
model*    Peers  are  known  to  be  effective  role  models  in  certain  circumstances 
(Cantor,  Alfonso,  &  Zillmann,  1976;  Conger,  1973;  Kimmel  &  Weiner,  1985;  Lueptow, 
1984;  Schunk,  1987;  Weitzman,  1979)*    Learners  may  find  talent  of  the  same  gender 
as  their  own  to  be  most  credible  (Pearson,  1982a,  1982b;  Schau  &  Tittle,  1985; 
Schuak,  1987)*    By  observing  peer  models,  adolescents  learn  about  and  often  adopt 
attitudes  and  behaviors  which  they  feel  are  appropriate  for  their  gender  as  well 
as  for  their  age  (Kimmel  &  Weiner,  1985;  Lueptow,  1984;  Schunk,  1987)*  However, 
the  tendency  to  sex-type  computers  and  computing  as  an  activity  more  appropriate 
for  males  than  for  feaiales  (Campbell,  1984;  Elmer-DeWitt ,  1986;  Lockheed,  1985b; 
Sanders,  1985;  Sanders  &  Stone,  1986;  Schubert,  1984)  conceivably  affects  the 
perceived  credibility  of  female  peer  models  appearing  in  instructional 
presentations  on  computer  use* 

Female  talent  might  not  be  perceived  as  credible,  solely  on  the  basis  of 
gender,  when  presenting  information  pertaining  to  the  traditionally  male  domain 
of  computers  and  compvter  use*    Because  adolescent  females  are  considered  to  be 
the  learners  at  risk  in  terms  of  computer  instruction,  and  because  the 
credibility  of  female  talent  for  both  female  and  male  learners  is  unknown  in  this 
context,  the  present  study  specifically  investigated  the  credibility  of 
adolescent  female  talent  within  the  context  of  computer  instruction*    Both  female 
and  male  adolescents  observed  computer-using  female  models,  and  the  gender  of  the 
learner  served  as  an  independent  variable  in  the  present  study* 

Another  gender-related  social  message  about  computers  which  learners  may 
receive  is  that  computing  is  a  solitary  activity  and  therefore  more  appropriate 
for  males*    Lueptow  (1984)  suggests  that  traditional  sex  role  stereotypes 
associate  the  female  sex  role  with  the  characteristics  of  expressiveness, 
affective  concern,  relationship-orientation,  nurturance,  communion,  and 
cooperation*    The  male  sex  role  is  traditionally  associated  with  characteristics 
such  as  independence,  self-sufficiency,  task-relevant  orientation,  autonomy, 
self-reliance,  and  individualism*    As  Lueptow  and  others  are  quick  to  note,  these 
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qualities  associated  with  female  and  male  sex  roles  are  generalizations  and  are 
neither  good  nor  bad,  but  emerge  as  characteristics  with  which  female  and  male 
sex  roles  traditionally  have  been  associated* 

These  patterns  of  adolescent  sex  role  development  Indicate  that  females  are 
encouraged  to  form  social  relationships  and  to  focus  on  Interpersonal  activities, 
which  conflicts  with  the  ways  In  which  computer  utilization  often  Is  portrayed 
and  taught •    Studies  conducted  by  equl      organizations  Indicate  that  adolescent 
"girls  generally  prefer  people  to  things  and  enjoy  working  In  groups  more  than 
pursuing  solitary  activities.    Friendships  and  social  Interactions  are  Important 
at  this  age  but  are  rarely  encouraged  In  computer  work"  (Sealfon,  1986,  p»  54)* 
The  presence  of  other  female  friends  and  the  ability  to  work  in  pairs  at  a  single 
machine  are  strong  Inducements  for  female  adolescents*  participation  in  computing 
activities,  with  the  implication  for  educators  being  "to  encourage  groups  of 
girls  —  friendship  groups  —  rather  than  individual  girls  to  use  the  computer" 
(Sanders,  1985,  p.  26).    It  is  conceivable  that  portraying  female  computer-using 
talent  in  pairs  rather  than  as  individuals  may  indicate  to  female  learners  that 
computer  use  is  an  activity  in  line  with  the  traditionally  female  concerns  for 
friendships  and  cooperation.    Schunk  (1987)  also  notes  that  multiple  models  may 
increase  the  effectiveness  of  observational  learning  situations.    Such  paired 
portrayals  may  affect  the  credibility  of  the  talent  appearing  in  instructional 
presentations*    Individual  or  paired  female  talent  was  a  second  Independent 
variable  in  the  present  study. 

Another  potential  influence  on  perceived  credibility  of  the  talent  is  a 
learner'^  attitude  toward  the  topic  of  instruction.    Bloom's  (1976)  theory  of 
school  learning  suggests  that  attitudes  toward  a  topic  which  students  bring  with 
them  to  the  instructional  setting  will  Influence  both  cognitive  and  affective 
learning  outcomes.    Reece  and  Owen  (1985)  corroborate  Bloom's  research  within  the 
context  of  computer  instruction.    Learners'  existing  attitudes  toward  computers 
may  influence  their  perceptions  of  the  credibility  of  the  talent  appearing  in 
instructional  media  presentations  on  computer  utilization.    Learners'  attitude 
toward  computers  served  as  an  Independent  variable  during  the  study. 

This  study  examined  adolescent  learners'  perceptions  of  talen*-  credibility 
in  the  contex*:  of  media  presentations  on  computer  utilization.    Specifically,  the 
study  investigated  the  effects  of  1)  learners'  gender,  2)  learners'  attitudes 
toward  computers,  and  3)  presentation  of  individual  or  paired  female  peer  talent 
on  eighth  grade  learners'  ratings  of  perceived  talent  credibility.    The  study 
sought  answers  to  the  following  questions: 

1.  Is  perceived  talent  credibility  affected  by  learners'  gender? 

2.  Is  perceived  talent  credibility  affected  by  learners'  attitude  toward 
computers? 

3.  Is  perceived  talent  credibility  affected  by  the  number  of  female  talent 
appearing  in  each  visual? 

4.  Is  perceived  talent  credibility  affected  by  interactions  between  or 
among  learners'  gender,  learners'  attitudes  toward  computers,  and  number 
of  talent? 
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Method 


Subjects 


Subjects  for  this  study  were  96  eighth  grade  student  volunteers  (56  females, 
40  males)  enrolled  in  careers  and  communications  classes  at  a  middle  school  (7th 
-  8th  grade)  located  in  the  metropolitan  Oklahoma  City  area.    Seventy  percent  of 
all  students  enrolled  in  the  school  take  the  careers  and  communications  classes • 
Subjects  ranged  in  age  from  13  to  15  years,  with  the  majority  of  the  participants 
being  14  years  old.    Ethnic  distribution  of  students  in  the  school  was  95% 
Caucasian  with  the  remaining  5%  of  students  representing  Mexican-American,  Black, 
Vietnamese,  and  American  Indian  students.    Students  in  this  particular  school 
district  had  been  briefly  introduced  to  computers  at  the  elementary  school  level, 
but  the  middle  school  had  no  formal  computer  education  program.    Some  students 
had  access  to  microcomputers  in  the  school  media  center,  homes,  or  parents'  place 
of  employment. 


Part  I  of  the  Minnesota  Computer  Literacy  and  Awareness  Assessment,  Form  8, 
(Anderson,  Klassen,  Krohn,  &  Smith-Cunnien,  1982),  hereafter  referred  to  as  the 
MECC  assessment,  was  used  to  determine  learners'  extant  attitudes  toward 
computers  at  the  beginning  of  the  study  for  purposes  of  randomly  assigning 
students  to  treatment  groups.    An  alpha  reliability  of  .85  was  obtained  using  the 
instrument  in  the  present  study,  which  adds  credence  to  its  status  as  an 
appropriate  instrument  to  use  in  similar  situations. 

Perceived  talent  credibility  was  quantifie4  using  a  scale  adapted  from  the 
McCroskey  Scales  for  the  Measurement  of  Ethos  (1966),  with  content  and  face 
validity  of  the  adapted  instrument  verified  by  experts  in  the  field  of 
communications.    As  with  the  original  instrument,  talent  credibility  scores  were 
composed  of  two  subscales:     1)  authoritativeness  (competence)  and  2)  character 
(trustworthiness).    The  internal  consistency  for  the  first  and  second 
administrations  of  this  scale  during  the  current  study  were  .95  and  .96 
respectively.    Cronbach  alpha  reliabilities  for  the  authoritativeness  subscale 
were  •94  and  .95  for  the  first  and  second  administrations  of  the  instrument, 
while  alpha  reliabilities  for  the  character  subscale  were  .92  and  .95 
respectively.    These  results  indicate  that  this  instrument  may  prove  useful  in 
future  research  to  measure  the  perceived  credibility  of  talent  delivering 
instructional  messages  about  computers. 

Students  also  answered  open-ended  questions  about  their  perceptions  of  the 
overall  credibility  (authoritativeness  and  character)  of  the  talent.    At  the 
conclusion  of  the  treatment  sessions,  students  responded  to  open-ended 
questionnaires  asking  them  to  describe  classroom  situations  in  which  they  would 
most  like  to  learn  about  using  computers. 

Four  short  slide-tape  shows  were  produced  by  the  researcher  which  depicted 
individual  or  paired  female  talent  delivering  the  introduction  to  a  media 
presentation  on  computer  utilization.    Talent  were  selected  who  were  similar  to 
the  majority  of  subjects  in  age  and  ethnic  background.    The  two  14  year-old 
females  selected  as  talent  dressed  similarly  and  were  photographed  working  as 
individuals  and  also  working  in  pairs  in  a  computer  classroom.    Care  was  taken  to 
duplicate  the  positioning,  expression,  and  overall  content  of  each  scene  as  the 
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talent  were  changed.    An  adolescent  female  with  an  articulate >  pleasant  voice 
served  as  the  narrator •    The  same  taped  version  of  the  narration  was  used  in  each 
of  the  treatment  conditions. 


To  control  for  variables  other  than  individual  or  paired  presentation  which 
might  contribute  to  the  perceived  credibility  of  the  talent,  counterbalanced 
treatment  materials  were  prepared.    To  help  control  for  differences  in  physical 
appearance  of  the  two  talent »  Talent  A  appeared  as  the  individual  talent  In  one 
treatment  and  Talent  B  appeared  as  the  individual  talent  in  another  treatment. 
The  two  females  also  appeared  together  in  versions  of  the  paired  talent 
treatment.    One  paired  version  portrayed  Talent  A  as  the  main  or  central  focus  of 
the  photograph,  with  Talent  B  also  appearing  in  the  slide  (Talent  A/Talent  B). 
The  other  version  portrayed  Talent  B  as  the  central  figure »  with  Talent  A 
appearing  as  the  second  adolescent  involved  (Talent  B/Talent  A).    Controlling  for 
order  effects  dictated  four  treatment  groups  in  which  students  viewed  either 
individual  or  paired  presentations  in  differing  order:     1)  Talent  A  first,  Talent 
B  second >  2)  Talent  B  first,  Talent  A  second,  3)  Talent  A/Talent  B  first,  Talent 
B/Talent  A  second,  and  4)  Talent  B/Talent  A  first.  Talent  A/Talent  B  second. 
Though  four  treatment  groups  were  utilized,  results  from  the  appropriate  groups 
were  combined  to  yield  individual  treatment  data  and  paired  treatment  data. 

Procedure 

The  MECC  attitudinal  assessment  was  administered  to  96  initial  participants 
in  their  respective  classrooms  during  four  consecutive  class  periods.  Taped 
directions  were  played  by  a  female  adult  proctor  and  the  regular  male  teachers 
were  present  in  each  classroom  during  the  administration  of  the  instrument.  As 
was  the  case  with  all  test  materials,  students'  names  and  additional  information 
had  been  coded  onto  answer  sheets  prior  to  their  distribution.    For  both  the  MECC 
assessment  and  the  Perceived  Talent  Credibility  scales,  students  marked  their 
responses  to  Likert-type  questions  directly  on  computer  answer  sheets.  Responses 
were  optically  scanned  and  scored ,  and  10%  of  the  response  sheets  were  hand 
checked  and  found  to  be  accurately  processed  by  the  computer. 

Statistically  significant  differences  were  found  in  the  scores  between 
female  learners  ( M  «  71.50)  and  male  learners  (M  «  76.33)  on  the  MECC  assessment, 
t^(72.70)  »  2.09,  £<.05,  two-tailed.    For  this  reason,  female  subjects  were 
categorized  as  having  positive  attitudes  toward  computers  if  their  scores  were 
above  72  and  negative  attitudes  toward  computers  if  their  scores  were  72  or 
below.    Similarly,  male  subjects  whose  scores  were  76  and  above  were  considered 
to  have  positive  attitudes  toward  computers  while  male  subjects  with  scores 
falling  below  76  were  categorized  as  having  negative  attitudes  toward  computers. 
After  female  and  male  participants  had  been  categorized  as  having  positive  or 
negative  attit  des  toward  computers,  stratified  random  assignment  by  gender  and 
attitude  coward  computers  was  used  to  assign  students  to  one  of  four  treatment 
groups. 

Three  days  later,  91  students  present  to  participate  in  the  remainder  of  the 
study  were  directed  to  one  of  four  classrooms  where  they  viewed  the  appropriate 
versions  of  the  slide-tape  presentations  and  completed  the  Perceived  Talent 
Credibility  scale  <?uring  their  regular  55-minute  class  periods.    Tape  recorded 
instructions  to  the  students  were  administered  by  adult  male  teachers  who 
directed  the  data  collection  procedures  in  each  classroom.    Students  in  each 
treatment  group  viewed  a  slide-tape  presentation  and  then  answered  both  the 
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multiple  choice  and  open-*ended  questions  regarding  perceived  talent  credibility. 
Student  responses  to  the  first  presentation  were  collected,  and  each  group  of 
students  then  viewed  the  second  slide-tape  production.    Students  again  answered 
the  questions  regarding  the  perceived  credibility  of  the  talent  and  an  open-ended 
question  on  their  preferences  for  classroom  situations  In  which  they  would  most 
enjoy  learning  about  computers. 


Results 

Main  and  Interaction  Effects 

A  three-way  factorial  analysis  of  variance  (ANOVA)  was  used  to  determine 
whether  the  dependent  measure,  perceived  talent  credibility  scores,  was  affected 
by  learners*  gender  (female  or  male),  learners'  attitude  toward  computers 
(positive  or  negative),  number  of  talent  (Individual  or  paired),  or  Interactions 
between  or  among  these  Indepandent  variables.    With  alpha  set  at  .05  and  power 
set  at  .80,  a  medium-large  effect  size  of  approximately  .30  would  have  been 
detected  with  the  sample  size  of  91  subjects.    No  significant  main  or  Interaction 
effects  were  detected  at  these  levels.    The  main  effect  for  learners'  attitude 
approached  significance  (p«.057).    There  was  a  consistent  trend  for  students  to 
assign  slightly  higher  credibility  scores  to  individual  rather  than  paired 
talent,  regardless  of  the  subjects*  gender  or  attitude  toward  computers.  The 
combined  effects  of  learners*  gender,  learners*  attitude  toward  computers,  and 
presentation  of  individual  or  paired  talent  accounted  for  8.5%  of  the  total 
variance  in  perceived  talent  credibility  scores. 

In  analyzing  the  subscale  for  authority  of  the  talent,  main  and  interaction 
effects  were  not  significant.    The  combined  effects  of  learners'  gender, 
learners*  attitude  toward  computers,  and  presentation  of  individual  or  paired 
talent  accounted  for  7.4%  of  the  variance  in  scores  for  the  subscale  measuring 
tale  nt  authoritativeness. 

In  analyzing  the  subscale  for  character  of  the  talent,  the  mean  score  for 
subjects  with  positive  attitudes  toward  computers  was  I30'>48,  and  the  mean  score 
for  students  with  negative  attitudes  toward  computers  was  123.32 •    The  ANOVA 
indicated  a  significant  main  effect  for  learners'  attitude,  JF(1,  83)  «  3.98, 
£<.05.    Other  main  and  interaction  effects  were  not  significant.    The  combined 
effects  of  learners*  gender,  learners'  attitude  toward  computers,  and 
presentation  of  individual  or  paired  talent  accounted  for  11.8%  of  the  variance 
in  scores  for  the  subscale  measuring  talent  character. 

Open-ended  Responses 

In  responses  to  open-ended  questions,  the  most  frequent  reason  students 
cited  for  perceiving  the  talent  as  credible  was  the  fact  that  the  talent  had  been 
chosen  to  appear  in  a  media  presentation.    Because  talent  had  been  selected  to 
appear  in  an  instructional  production,  subjects  believed  them  to  be  both 
competent  and  trustworthy  sources  of  information  about  computers.    The  most 
frequent  reason  cited  for  not  perceiving  the  talent  as  credible  was  lack  of 
substantial,  in-depth  computer  related  content  in  the  slide-tape  program. 

When  asked  whether  they  would  rather  work  with  a  computer  alone  or  with  a 
friend,  chi  square  calculations  revealed  a  statistically  significant  difference 
between  the  responses  of  females  and  males.    Females  expressed  more  frequent 
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preferences  for  using  computers  with  a  friend  than  did  males:    xHly  N[  «  88)  » 
3#84,  jg<.05.    Females  with  positive  or  negative  attitudes  toward  computers  did 
not  differ  significantly  from  each  other  in  their  preferences  for  working  on 
computers  alone  or  in  pairs.    Seventy-three  percent  of  all  females  indicated  a 
preference  for  working  on  computers  in  pairs »  regardless  of  their  attitude  toward 
computers.    Males  with  positive  attitudes  did  not  differ  significantly  from  males 
with  negative  attitudes,  with  fifty-three  percent  of  all  males  indicating  a 
preference  for  working  on  computers  in  pairs,  regardless  of  their  attitudes 
toward  computers.    No  significant  relationship  was  found  between  gender  of 
students  with  positive  attitudes  toward  computers  and  their  stated  preferences. 
Chi  square  calculations  revealed  a  significant  relationship  between  gender  of 
students  with  negative  attitudes  toward  computers  and  their  preferences  for  using 
computers,  with  females  preferring  to  work  with  a  friend;     xHl^  N[  *  42)  »  7.74, 
2.<.01. 


Discussion 

Main  and  Interaction  Effects 

Seve.  al  considerations  are  raised  by  the  failure  of  the  three-way  ANOVA  to 
detect  sig.\ificant  main  or  interaction  effects  upon  perceived  talent  credibility 
scores.    Df  :a  indicate  that  the  gender  of  the  learner  did  not  affect  the 
perceived  (.redibility  ratings  of  female  peer  talent  appearing  within  the  context 
of  computer  instruction.    Data  collected  in  the  open**-ended  questionnaires 
indicate  that  the  fact  that  a  particular  talent  had  been  chosen  to  appear  in  an 
instructional  presentation  contributed  to  the  credibility  of  the  talent. 
Apparently,  learners  of  both  genders  were  willing  to  believe  that  female  talent 
who  appeared  in  media  presentations  were  both  competent  and  trustworthy  or  they 
would  not  have  been  selected  to  serve  as  talent.    Results  of  this  study  support 
the  proposition  that,  in  light  of  recent  calls  for  computer-using  female  role 
models,  female  peer  talent  may  be  used  in  instructional  presentations  without 
Jeopardizing  the  talents^  credibility  for  female  or  male  learners. 

The  main  effect  for  differences  in  perceived  credibility  scores  for  learners 
with  positive  or  negative  attitudes  toward  computers  approached  significance. 
Statistically  significant  differences  in  scores  on  the  character 
(trustworthiness)  subscale  were  found  for  learners  with  positive  or  negative 
attitudes  toward  computers.    These  results  suggest  that  attitude  toward  a  topic 
influences  the  credibility  of  a  talent  delivering  instructional  messages. 
Subjects  with  positive  attitudes  toward  computers  rated  talent  higher  in 
credibility  than  did  students  with  negative  attitudes  toward  computers.  Bloom 
(1976)  stresses  the  importance  of  Initial  attitude  toward  a  subject  or  task  as  a 
major  factor  influencing  both  cognitive  and  affective  learning  outcomes,  and  it 
appears  that  initial  positive  attitudes  towards  a  subject  may  increase  the 
credibility  of  the  talent  delivering  information  on  that  topic  as  well. 
Specifically,  it  appears  that  learners  with  positive  attitudes  toward  computers 
perceive  talent  as  more  trustworthy  than  do  learners  with  negative  attitudes 
toward  computers. 

No  main  effect  for  individual  or  paired  talent  presentation  was  found, 
though  a  consistent  trend  indicated  that  learners,  regardless  of  gender  or 
attitude  toward  computers,  rated  individual  talent  slightly  higher  in  perceived 
credibility  than  paired  talent.    One  possible  explanation  is  that  individual 
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talent  versions  suggested  to  the  audience  that  the  talent  was  an  expert  while 
paired  talent  versions  suggested  a  subtle  lack  of  expertise  on  the  part  of  each 
individual.    Since  students  viewing  the  paired  treatment  versions  had  less 
variety  in  the  visual  presentations  than  those  subjects  who  viewed  individual 
versions  9  boredom  was  considered  a  potential  reason  for  slightly  lower 
credibility  scores*    However,  credibility  scores  of  individual  talent  were 
slightly  higher  than  paired  talent  score'  on  the  first  administration  of  the 
instrument  as  well  as  on  the  second,  discounting  this  possibility*    Results  of 
this  study  indicate  that  the  presence  of  individual  or  paired  female  peer  talent 
made  virtually  no  difference  in  perceived  credibility  scores  for  eighth  grade 
learners* 

No  interaction  effects  were  found  to  exist*    However,  the  median  split 
procedure  used  to  assign  learners  to  groups  of  students  with  positive  and 
negative  attitudes  toward  computers  may  have  obscured  results  which  might  have 
been  found  using  extreme  group  comparisons*    The  current  study  was  conducted 
utilizing  thd  median  split  procedure  as  it  was  thought  to  be  a  more  true 
reflection  of  conditions  existing  in  actual  classroom  learning  situations* 
Again,  options  for  future  research  exist*    Additionally,  the  combined  effects  of 
learners*  gender,  learners'  attitudes  toward  computers,  and  presentation  of 
individual  or  paired  female  talent  accounted  for  only  8*5%  of  the  total  variance 
in  perceived  talent  credibility  scores*    This  fin  ling  indicates  that  other 
factors  not  investigated  in  this  study  contribute  to  the  perceived  credibility  of 
talent  appearing  in  instructional  media  presentations  and  suggests  an  avenue  for 
further  research* 

Open-'ended  Responses 

Of  the  subjects  who  did  not  believe  the  talent  was  credible,  the  majority 
cited  the  failure  of  the  talent  to  provide  them  with  substantial  computer-related 
information  as  the  reason  for  low  talent  credibility*    Of  the  subjects  who  found 
the  talent  to  be  credible,  the  majority  stated  that  they  did  so  because  they  had 
learned  something  about  computers  from  the  presentation*    Research  (Andersen  & 
Clevenger,  1963;  Bowers  &  Phillips,  1967;  Brock,  1965)  indicates  that  the 
inclusion  of  specific  content  into  the  treatment  presentations  may  introduce 
extraneous  variables  into  the  ratings  of  perceived  talent  credibility,  therefore 
the  slide--tape  treatments  had  been  designed  to  be  as  free  from  specific 
computer-related  content  as  possible*    Data  from  the  open-ended  questionnaires 
support  the  contention  that  the  informational  content  of  an  instructional  message 
will  influence  the  perceived  credibility  of  the  talent  and  that  viewers  may  judge 
the  credibility  of  the  talent  by  comparing  what  the  talent  says  to  the  learner's 
personal  expertise* 

Viewing  individual  or  paired  talent  presentations  had  no  relationship  to 
students'  stated  preferences  for  working  with  computers  alone  or  with  a  friend  as 
indicated  in  open-ended  responses*    However,  responses  to  the  questions  did 
suggest  that  students'  gender  and  attitude  toward  computers  were  related  to  their 
preferences^  for  working  alone  or  in  pairs*    Female  students,  in  comparison  to 
male  students,  were  found  to  express  a  statistically  significant  preference  for 
working  on  a  computer  with  a  friend*    This  relationship  appeared  to  be  most 
influenced  by  female  learners  with  negative  attitudes  toward  computers*  Females 
with  negative  attitudes,  in  contrast  to  males  with  negative  attitudes,  expressed 
a  significant  preference  for  learning  about  computers  with  a  friend*    Gender  was 
not  related  to  preferences  of  students  with  positive  attitudes*    These  findings 
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lend  support  to  the  idea  of  teamwork  as  a  proposed  educational  intervention  for 
encouraging  females  to  participate  in  computer  learning  activities  (Sanders, 
1935;  Sanders  and  Stone,  1986)  and  suggest  that  working  in  pairs  may  be  an 
especially  attractive  option  for  females  with  negative  attitudes  toward 
computers.    Further  research  in  this  area  is  warranted.    Additional  research  is 
also  needed  to  determine  more  specific  effects  of  talent  credibility  upon 
cognitive  and  affective  learning  outcomes  when  computers  are  the  subject  of 
instruction. 
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Background  and  Issues 


Instructional  Technology  graduates  work  in  diverse  settings, 
principally  educational  systems  (both  K-12  and  higher  education) , 
private  sector  training  environments,  and  health  and  human  service 
training  departments*    Consequently,  Instructional  Technology  (IT) 
academic  programs  cover  a  broad  range  of  skills  and  application 
techniques,  and  the  students  are  as  diverse  as  their  vocational 
aspirations,  more  varied  than  other  students  in  schools  of  education* 

This  study  is  a  follow-up  of  one  particular  group  of  IT  graduates. 
It  looks  at  their  demographics  characteristics,  their  jobs,  the  programs 
they  elected,  and  their  perceptions  of  their  own  competence.  Moreover, 
since  Instructional  Technology  is  becoming  more  and  more  intertwined 
with  adult  learning  issues,  these  graduates  are  seen  as  adult  learners 
and  the  findings  are  discussed  in  light  of  that  literature. 

Most  adult  learners  are  not  in  higher  education  programs  (only  14% 
are,  according  to  Aslanian  and  Brickell,  1980).    The  graduates  are  thus 
not  representative  of  adult  learners,  in  general.    However,  they  are 
typical  adult  learners  in  that  their  interests  are  primarily  job-related 
(Darkenwald  and  Merriam,  1982).    In  addition,  the  graduates  in  this 
study  seem  typical  of  many  professionals  of  the  future  because  of  their 
interest  in  career  changes.    Over  forty  percent  reported  that  the 
primary  reason  they  began  this  graduate  program  was  to  enable  them  to 
change  careers,    primarily  from  teaching  positions  to  private  sector 
training. 

As  with  many  follow-up  studies,  this  one  is  concerned  with  both  the 
competency  of  the  graduates,  as  well  as  on-th-job  success,  and  the 
extent  to  which  these  results  can  be  attributed  to  the  academic  program. 
However,  other  variables  have  also  been  included  because  of  the  adult 
learning  context.    Previous  studies  of  adult  education  parti<:ipation 
have  highlighted  the  importance  of  certain  demographic  characteristics 
(e.g.  age,  sex,  and  sociO'-economic  status),  and  life  experiences 
(Aslanian  and  Brickell,  1980;  Cookson,  1986;  Scanlan,  1986;  Shipp  and 
McKenzie,  1981).    In  addition  to  these,  this  study  considers  the  role  of 
certain  affective  characteristics  of  the  graduates.    These  types  of 
variables  have  explained  much  of  the  achievement  of  children  in  school 
situations  (Bloom,  1976) ,  and  similar  findings  have  been  reported  for 
adults  (Cookson,  1986;  Darkenwald  and  Valentine,  1985;  Stamatis,  1986), 

Figure  1  below  summarizes  the  model  of  variable  clusters  which 
served  as  the  framework  for  this  study* 
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FIGURE  1 


A  Model  of  Variable  Clusters 
Relating  to  Competence  in  Instructional 
Technology  and  On-the-job  Success 
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Research  Goals  of  the  Study 

The  specific  research  questions  explored  in  this  study  are: 

1.  What  are  the  relationships  between  self-assessed  competency 
levels  and  learner  characteristics,  including: 

a*      demographics  (sex,  age,  marital  status,  and  educational 
background) , 

b.  situational  background  (activity  level,  and  number  of 
children) , 

c.  personality  self-assessments  (assertiveness,  leadership, 
human  interaction) , 

d.  employment  experiences  (settings,  job  title,  income 
level) ,  and 

e.  reasons  for  program  participation. 

2.  What  are  the  relationships  between  self-assessed  competency 
•levels  and  academic  program  characteristics,  including: 

a*      total  number  of  courses  elected,  and 
b*      type  of  track  elected. 

3.  What  are  the  relationships  between  self-assessed  competency 
level  and  key  employment  characteristics,  including: 

a.  current  income, 

b.  employment  setting, 

c.  job  title,  and 

d.  on-the-job  use  of  IT  skills. 

4.  What  are  the  relationships  betwc.i  current  income  and  key 
learner  characteristics,  including: 

a.  demographics  (sex,  age,  marital  status,  and  educational 
background) , 

b.  personal  background  (activity  level,  and  number  of 
children) , 

c«      personality  self-assessments  (assertiveness,  leadership, 
human  interaction), 

d.  employment  experiences  (setting,  job  title,  income 
level) ,  and 

e.  reasons  for  program  participation. 


Procedures 

Population 

The  population  of  this  study  was  the  1980-1985  graduates  the 
Wayne  State  University  Instructional  Technology  programs.    These  include 
students  with  Master's  Degrees,  Educational  Specialist  Certificates,  and 
Doctorates  (both  Ph.D  and  Ed.D).    There  are  currently  404  active  IT 
students  in  these  programs  (264  at  the  masters  level,  53  educational 
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specialists,  and  87  doctoral  students,  of  which  71  are  in  the  Ph*D 
program).    Almost  all  of  the  students  are  enrolled  on  a  part-time  basis. 
Wayne  State  University  is  an  urban,  research  university  In  Detroit, 
Michigan  with  approximately  30,000  students.    The  University  is  close  to 
major  training  and  development  departments  housed  throughout  the 
automotive  industry,  computer  manufacturing  organizations,  public 
utilities  and  insurance  companies.    These  organizations  provide  diverse 
sites  for  practical  applications  in  the  IT  program,  as  well  as 
subsequent  employment  opportunities  for  graduates.    The  five  county  area 
also  has  K-I2  employment  sites,  and  large  intermediate  school  districts, 
many  community  colleges,  and  other  four-year  colleges  and  universities. 

Data  Collection  and  Instrumentation 

A  mail  survey  instrximent  was  constructed  which  covered  all  of  the 
variables  for  the  study.    The  Instrument  also  included  a  self-assessment 
of  56  IT  competencies. 

The  competency  list  (See  Appendix  A)  was  based  upon  several  other 
documents  identifying  critical  IT  competencies.    The  first  list  used  was 
the  core  competencies  for  instructional/training  development  developed 
by  the  Task  Force  on  ID  Certification  of  the  AECT  Division  of 
Instructional  Development  (Task  Force  on  ID  Certification,  1981). 
Secondly,  competency  lists  used  by  private  organizations  f ^r  employee 
evaluations  were  used.    These  lists  were  combined  and  standarized  in 
format.    Finally,  changes  were  made  to  be  congruent  with  the  Wayne  State 
IT  program. 

Surveys  were  mailed  to  263  graduates.    Fifty-eight  were  returned 
because  of  inaccurate  addresses;  thus  the  population  was  reduced  to  205 
graduates.    With  a  37%  return  rate,  the  total  number  of  responses 
available  for  analysis  was  75.    There  was  no  follow-up  to 
non-respondents . 

Date  Analysis  Methods 

The  model  shown  in  Figura  2  provided  the  initial  hjrpotheses.  Path 
analysis  was  conducted  co  evaluate  and  more  fully  define  this  model. 

Job  success  (see  Figure  2)  was  measured  by  self-reported  1986 
income.    Job  description  was  measured  by  job  title  and  emplo3rTnent 
setting,  and  the  frequency  with  which  the  graduates  used  the  56  IT 
competencies.    The  IT  academic  program  was  first  described  by  simply 
identifying  the  total  number  of  Instructional  Technology  and  Evaluation 
and  Research  courses  elected.    Then  the  program  was  described  by  more 
specific  program  tracks. 

These  tracks  were  determined  by:  1)  identifying  those  courses 
commonly  elected  that  form  the  core  of  classes,  and  2)  performing  a 
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factor  analysis  of  the  remaining  course  election  data  to  identify 
distinctive  patterns  of  course  election •    The  common  core  group  was 
separated  from  the  analysis  since  it  represented  the  least  variance* 
Graduates  were  identified  with  the  track  in  which  they  had  elected  the 
largest  fraction  of  courses  when  compared  to  the  other  tracks*  These 
tracks  were  then  used  to  distinguish  the  various  academic  programs  of 
the  graduates  in  this  study. 


The  intent  of  the  study  was  to  investigate  the  linkfs  between  the 
characteristics  of  students,  academic  preparation  in  Instructional 
Technology,  competency  attainment,  and  on-the-job  success-    The  major 
conclusion  that  can  be  drawn  from  the  data  is  that  interactions  do  not 
exist  between  all  of  these  variables*    It  seems  that  there  are  two 
distinct  models.    The  first  explains  the  links  between  learners* 
characteristics  (demographic,  situational,  and  occupational)  and  their 
reasons  for  program  participation  and  on-the-job  success,  as  defined  by 
income  level.    The  nature  of  the  academic  program  or  the  level  of 
competency  attainment  can  not  be  seen  as  predictors  of  job  success  in 
this  model.    The  second  model  explains  competency  attainment  in  terms  of 
the  academic  program,  the  frequency  of  use  of  the  various  IT  skills  on 
the  job,  and  learner  characteristics,  primarily  personality  variables. 
These  two  models  will  be  described  in  the  following  section. 

A  Model  of  IT  Program  Participation  and  On-the-Job  Success 

The  model  in  Figure  1  shows  the  effects  of  Instructional  Technology 
program  participation  on  the  1985  income  of  graduates.    This  is  a  model 
which  focuses  on  life  experience  variables,  both  family  and 
professional,  as  motivation  for  program  participation.    It  also  tends  to 
explain  what  can  depress  income,  rather  than  explain  high  incomes. 

Demographic  Characteristics  of  Learners    The  only  significant 
demographic  characteristic  to  explain  income  level  is  sex.     (See  Table  1 
in  Appendix  B  for  the  data  supporting  the  relationships  found  between 
the  causal  variables  and  the  endogenous  variables  and  the  dependent 
variable,  1985  income.)    As  has  been  repeatedly  reported,  females  earn 
lower  salaries  than  males.    The  results  of  this  study  are  no  different. 
Being  female  explained  lower  salaries. 

It  is  interesting  to  note  that  the  male-female  split  in  this  study 
was  almost  precisely  the  split  that  has  been  found  among  adult  learners 
in  general  (Aslaniane  and  Brickell,  1980),  a  49%-51%  division.  This  is 
true  even  though  the  IT  population  is  not  representative  of  the  typical 
adult  learner  in  other  respects,  principally  age,  education  level,  and 
employment  rate.  (See  Appendix  C  for  the  demographic  data  comparing  the 
IT  graduates  to  general  adult  learners.) 


Two  Models  of  the  Effects  of  Academic 
Preparation  in  Instructional  Technology 
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Figure  2 
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A  Model  of  Instructional  Technology 
Program  Participation  and  its  Effects 
'upon  on-the-job  Success* 


-.207 


*  =     Path  Coefficients  are  indicated  on  each  path 
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Personal  Traits  and  Experiences.    Anslanlan  and  Brlckell's  (1980) 
extensive  study  of  life  changes  as  reasons  for  the  causes  and  timing  of 
adult  learning  Identified  a  cause  and  effect  relationship  between  life 
circumstances,  which  preceeded  transitions,  and  learning.    In  this 
study,  the  situational  variable  which  most  affected  an  Individual's 
motivation  to  begin  graduate  study  were  the  ages  of  his  or  her  children. 
This  Is  evident,  however,  only  In  the  cases  of  those  students  who 
entered  the  IT  program  with  the  Intention  of  making  career  changes.  In 
such  Instances,  both  men  and  women  delayed  starting  graduate  study  until" 
their  children  were  In  school. 

Given  the  previously  discussed  effects  of  being  female  on  Income 
level,  the  effects  of  an  Interaction  between  being  female  and  having 
children  were  also  examined*    This  process  did  reveal  some  effects,  but 
only  of  an  Indirect  nature.    The  Interaction  between  females  and 
children  does  not  explain  1985-  Income,  nor  job  titles,  nor  reasons  for 
IT  program  participation.    What  was  discovered  was  that  the  1980  Income 
was  negatively  effected  by  this  combination.    Therefore,  since  the  1980 
Income  Is  a  powerful  predictor  of  the  1985  Income,  the  effects  of  this 
Interaction  are  Important. 

Employment  History.    The  graduates'  occupational  experiences  proved 
to  be  key  variables  In  both  models  which  have  emerged  from  this  study. 
Here,  It  precipitated  enrollment  In  the  IT  program  for  many.    A  low 
Income  In  1980  seemed  to  motivate  the  career  changers  to  pursue  graduate 
study. 

Being  a  teacher  explained  the  lower  1985  salaries  In  this  study; 
although  conversely  It  was  not  true  that  holding  other  job  titles 
explained  the  higher  Incomes.    Nevertheless,  there  was  a  tendency  for 
the  highest  Incomes  to  be  earned  by  those  In  non-education  settings,  or 
by  those  who  were  In  education,  but  not  classroom  teachers  (primarily 
school  administrators) . 

Reasons  for  Program  Participation.     A  central  part  of  the 
on-the-job  success  model  Is  the  role  of  the  reasons  students  had  for 
Initially  entering  the  IT  graduate  program.    Data  was  collected  In 
relation  to  three  reasons  for  graduate  study  —  to  obtain  an  advanced 
degree,  to  prepare  for  advancement  In  one's  current  job,  and  to  prepare 
for  a  career  change.    The  latter  reason  proved  to  be  a  predictor  of  1985 
income • 

The  major  difference  between  the  career  change  sub-group  and  the 
total  population  of  the  study  is  that  the  former  group  did  appear  to 
make  the  desired  job  changes.    In  1980,  50%  of  those  who  intended  to 
change  careers  were  employed  as  teachers;  19.7%  were  employed  in 
non-education  jobs  and  nearly  13%  were  unemployed.    Five  years  later  no 
one  was  unemployed,  40.7%  were  working  in  non-education  jobs,  and  just 
under  30%  were  still  teachers* 
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However,  making  these  career  changes  seems  to  have  had  a  depressing 
effect  upon  salaries.    It  is  hypothesized  that  since  these  persons  have 
been  in  their  new  positions  for  a  relatively  short  period  of  time,  they 
have  not  yet  begun  to  advance  and  salaries  are,  therefore,  lower. 

A  Model  of  Academic  Preparation,  On-the-Job  Skill  Use  and 
Competency  Attainment 

The  second  model  resulting  from  this  study  emphasizes  the  IT 
academic  program  itself  and  the  extent  to  which  competencies  were 
acquired,  as  measured  by  self-assessments.    While  life  experiences  were 
important  to  program  participation,  the  critical  learner  characteristics 
in  this  context  are  personality  variables.    The  important  job 
descriptor's  are  the  extent  to  which  the  various  IT  skills  are  used  in 
the  workplace.    The  model  is  shown  in  Figure  3  below. 


Demographic  Characteristics  of  Learners >    Again,  the  only  major 
demographic  predictor  (now  in  relation  to  competency  self-assessment)  is 
sex.    However,  rather  than  having  a  negative  Impact  as  with  .salaries, 
being  female  Is  linked  here  to  higher  competency  assessmeats.  (See 
Table  2  in  Appendix  B  for  the  data  relating  the  causal  variables  to  the 
endogenous  variables  and  to  the  dependent  variable,  the  average  of  all 
IT  competency  self-assessments.)    While  sex  is  not  as  strong  a  predictor 
in  this  model  as  in  the  previous  situation,  the  contrasting  results  are 
nevertheless  noteworthy.    Either  the  women  graduates  are  giving 
themselves  positively  biased  competency  ratings,  or  there  is  little 
correlation  between  skill  and  income. 

Personal  Traits  and  Experiences.    Respondents  rated  themselves  in 
terms  of  three  personality  traits  ~  assertiveness,  leadership,  and 
outgoingness.    While  leadership  abilities  did  not  predict  competency 
attainment,  the  other  two  variables  did  have  a  positive,  though 
indirect,  relationship  to  overall  competency  self-assessment. 

Assertiveness  was  linked  to  the  on-the-job  use  of  IT  skills.  This 
may  indicate  that  in  the  workplace  self-initiative  explains  the  scope  of 
some  jobs.    In  addition,  those  persons  who  saw  themselves  as  being  more 
outgoing  tended  to  take  more  university  classes.    Perhaps  the  social 
aspect  of  graduate  programs  is  satisfying  and  contributes  to  competency 
attainment. 

The  IT  Academic  Program.    As  a  result  of  the  analysis  of  data 
rather  than  prior  program  definition),  the  IT  courses  elected  by  the 
respondents  of  this  study  were  divided  into  a  core  set  of  courses  and 
four  separate  tracks.    (See  Appendix  D  for  these  courses  and  the 
percentage  of  the  respondents  who  elected  each  course) «    The  four  course 
groups  are:    1)  the  doctoral  track,  2)  the  private  sector  training 
track,  3)  the  media  track,  and  4)  the  school  track. 

The  total  number  of  courses  taken  positively  predicts  overall 
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Figure  3 

A  Model  of  Instructional  Technology 
Academic  Preparation,  On-The-Job  Skill 
Use,  and  Competency  Attainment* 
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,145 


R  Square  »  .64 


Path  Coefficients  are  indicated  on  each  path 
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competency  assessments    However,  only  two  of  the  four  tracks  also  are 
related  to  the  overall  average  competency  rating •    The  doctoral  track, 
logically,  explains  higher  competency  assessments*    These  students  have 
not  only  participated  in  more  graduate  study  than  other  student  groups, 
but  they  are  superior  students  in  terms  of  traditional  academic 
standards*    On  the  other  hand,  the  media  track  has  a  negative  influence 
on  overall  competency  assessment*    There  is  a  danger  in  concluding  that 
students  in  this  track  are  less  competent  than  their  counterparts  in 
other  tracks*    It  is  hypothesized  that  media-oriented  students  tend  to 
be  more  specialized,  both  in  terms  of  course  election  and  in  skill 
application*    Since  the  dependent  variable  is  an  average  competency 
rating  for  all  56  competencies,  this  measure  may  be  biased  against 
students  with  specialized  areas  of  interest*    Moreover,  the  Wayne  State 
program  has  not  emphasized  traditional  media  production;  the  program  is 
more  design-oriented  and  the  student  population  is  skewed  towards  those 
in  private  sector  training*  > 

On-*the-Job  Skill  Use*    The  major  predictor  of  average  overall 
competency  assessment  is  the  frequency  of  use  of  these  same  competencies 
on  the  job^    On  separate  analyses,  this  same  relationship  occurred  when 
viewing  the  six  separate  competency  categories*    This  speaks  to  the 
great  importance  of  practice  and  application  of  skills  taught  in  the 
university  classroom* 

Although  not  reflected  in  the  general  model,  the  most  frequently 
used  skills  are  design  skills;  analysis  skills  are  the  second  most 
frequently  used*    The  least  used  competencies  were  in  the  development 
category,  highlighting  the  existence  of  IT  specializations  in  the  work 
place*    (See  Appendix  E  for  specific  data  describing  the  extent  of 
competency  use  on  the  job*) 


Summary 

This  study  has  resulted  in  two  general  models*    These  models 
theoretically  separate  academic  preparation  in  Instructional  Technology 
and  competency  attainment  from  on-the-job  success  (as  measured  by 
income)*    The  two  models  also  highlight  the  varying  roles  of  different 
types  of  learner  characteristics Academic  program  p^rticipation  and 
ultimately  income  level  is  linked  to  life  experiences,  while  personality 
variables  are  associated  with  IT  competency  attainment*    Thus  both 
models  support  the  need  to  consider  IT  students  in  more  dimensions  than 
learning  capacities  and  competence  in  the  discipline* 

Unlike  most  adult  learners,  demographic  characteristics  of  IT 
students  have  only  limited  effects  on  achievement  in  this  program*  The 
most  notable    exception  from  the  norm  is  the  absence  of  age  effects »  in 
this  context,  age  does  not  have  a  depressing  effect  on  achievement,  even 
though  this  IT  population  is  older  than  most  pre-retirement  adult 
learners*    However,  this  phenomenon  is  consistent  with  the  view  that  age 
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is  less  of  a  deterrent  to  those  who  are  receiving  instruction  within 
their  domains  of  interest  and  specialization  (Richey  in  press).  The 
only  critical  demographic  variable  is  sex. 

The  effects  of  career  changes  is  Important  to  many  IT  students « 
This  group  has  been  growing  at  Wayne  State.    In  this  study  73.3%  of  the 
career  changers  began  their  programs  since  1981.    In  spite  of  the 
resurgence  of  teacher  education 9  the  pattern  does  not  seem  to  be 
changing  to  any  great  extent.    Realistic  views  of  the  advantages  and 
disadvantages  of  making  career  changes  should  be  discussed  with 
students. 

The  competency  attainment  model  shows  the  importance  of  academic 
courscwork,  but  not  without  the  practice  that  occurs  on  a  job*  Perhaps 
ttore  emphasis  should  be  given  to  student  internships »  and  to 
incorporating  real  world  application  assignments  into  IT  classes. 

However,  one  is  finally  left  with  the  question  of  the  adoptability 
of  these  general  models  to  specific  areas  of  Instructional  Technology. 
While  the  sample  in  this  study  is  small,  the  more  detailed  analyses 
conducted  seem  to  point  to  the  strength  of  the  general  model.  In 
relation  to  competency  attainment,  analysis  by  competency  category 
resulted  in  essentially  the  same  relationships.    Moreover,  competency 
assessment  still  can  not  be  linked  to  on**the**job  success  if  the  data  is 
analyzed  more  specifically.    Therefore,  the  general  models  can  serve  as 
the  bases  of  hypotheses  of  cause  and  effect  relationships.    They  can 
lend  themselves  to  expanding  the  tests  of  these  relationships  to  other 
variables,  (e.g.  other  measures  of  on-*the-job  success  can  be  tested). 
The  models  can  serve  as  one  way  of  viewing  standard  program  follow-up 
data  In  ways  which  shed  light  on  adult  learning  and  the  role  of  key 
design  variables  in  instructional  programs. 
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22.  Write  Questionnaire/Survey  Instrument 

23.  Design/Conduct  Tryout  Phases 

24.  Design  Formative  Evaluations 

25.  Design  Summative  Evaluations 

26.  Evaluate  Instructional  Materials 

27.  Interpret  Evaluation  Data 

28.  Write  Evaluation  Reports 
DEVELOPMENT 

29.  Write  Self -Instructional  Modules 

30.  Write  Training  Manuals 

31.  Write  Learning  Guides 

32.  Write  Instructors  Guides 

33.  Write  Workbooks 

34.  Write  Job  Aids 

35.  Arrange  Copy  to  Enhance  Communication 

36.  Write  Audioscrtpts 

37.  Write  Sound/Slide  Scripts 

38.  Write  Multi-Image  Scripts 

39.  Write  Videodisk  Scripts 

40.  Design  Computer-Assisted  Instruction 

41.  Design  Computer-Managed  Instruction 

42.  Write  Role  Play,  Case  Study  Simulations 

43.  Develop  Learning  Games 

44.  Write  Brochures,  Flyers  etc. 
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45.  Produce  Mediated  Instruction 
MANAGEMENT 

46.  Design  Instructional  Management  Systems 
47*  Plan  For  Organizational  Change 

48.  Implement  Organizational  Change 

49*  Write  a  Funding  Proposal 

50.  Plan/Manage  a  Design  Project 

51*  Cost  a  Job  and  Develop  a  ^Budget 
COMMUNICATION 

52.  Interview  Subject  Matter  Experts 

53.  Demonstrate  Consulting  Skills 

54.  Demonstrate  Technical  Writing  Skills 

55.  Edit  Copy 

56.  Write  Design  Procedures 
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''Appendix  B 

Table  1     Hypothesized  Causes  of  1985 
Income  Level 

Table  2     Hypothesized  Causes  of  IT 
Competency  Self^Assessment 
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Hypothesized  Causes  of 
1985  Income  Level 


Endocenotis 
Variable 

Causal 
Variable 

B 

SE  B 

T 

Prob. 

Constant 

.70 

.301 

Entered  IT 
Program  to 
Make  Career  Change 

Has  Children 
Under  5 

-.37 

.152 

-2.40 

.020 

Mean- .419 
S-D.-.497 

Has  Children 
Ages  6-18 

.27 

.121 

2.19 

.032 

1980  Income 

-.05 

.030 

-1.79 

.079 

R  Square  ■ 

.15 

N  -  74 

Constant 

.13 

.075 

Teacher  in  1985     Teacher  in  1980 

.66 

.090 

7.35 

.000 

Mean- .400 
S.D.  «  .493 

Career  Change 
Intent 

R  Square  « 

-.16 
.49 

.091 
N  -  70 

-1.72 

.090 

Dependent 
Variable 

Causal 
Variable 

B 

SE  B 

T 

Prob. 

Constant 

6.70 

.878 

1985  Income 
Level 

1980  Income 

.51 

.088 

5.83 

.000 

Mean=7.10 
S.D.  «  1.91 

Career 

•1.11 

.357 

-3.43 

.001 

Teacher  in 
1985 

•1.13 

.367 

-3.08 

.003 

Sex 

-.78 

.371 

-2.11 

.039 

R  Square  » 

.57 

N   =  71 

.626 
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Hypothesized  Causes  of 
IT  Competency  Self-Assessiuent 


Endosenoti  s 
Variable 

Causal 
Variable 

B 

SE  B 

T 

Prob. 

Constant 

1.21 

,234 

Average  Frequency 
of  on-the-job  use 
of  all  IT  Skills 

Assertiveness 

.17 

.067 

2.58 

.012 

Mean  «  1.804 
S.D.  -  .396 

R  Square  >■ 

.10 

N  - 

66 

Constant 

.97 

3,77 

Total  Number  of 
Courses  Taken 

Outgoingness 

2,57 

,96 

-2.69 

.010 

Mean  »  10.947 
S.D.  -  4.992 

R  Square  ■ 

.12 

N  - 

75 

Dependent 
Variable 


Causal 
Variable 


SE  B 


Prob. 


Average 

Self -Assessment 
of  all  IT  compet- 
encies 

Mean  «  4.037 
S.D.  -  ,688 


Constant 


1.29 


Average  Freq,  ,88 
of  use  on  the  job 
IT  Skills 


Total  Number  .04 
of  Courses  taken 

Media  Academic  -.70 
Track 

Doctoral  Track  .51 
Sex  ,20 
R  Square    *  .64 


.492 
.152 


.012 

.182 

.242 
.120 
N  " 


5.77 


3.07 

-3.84 

2,11 
1.65 


,000 


.003 

.000 

.039 
.105 
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•Appendix  C 

A  Description  of  the  IT  Graduate 
Respondents  in  Comparison  to 
General  Adult- Learners'^ 


Table  3  -  Sex 

Table  4  -  Age 

Table  5  -  Marital  Status 

Table  6  -  Highest  Degree 

Table  7  -  Employment  Status 

Table  8  -  Ages  of  Children 


*Data  from  Aslanian  and  Brickell  (1980) 
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Table  3 

A  Comparison  of  IT  Graduates 
and  General  Adult  Learners:  Sex 


Sex 

Male 
Female 


IT  Graduates 
(N"75) 

48, OZ 
50.7 


Adult  Learners 
51 


Difference 
(in  Z) 

-.1% 
-.3 


Age 

'26-30 
31-35 
36-45 
46-55 
Over  55 


Table  4 

A  Comparison  of  IT  Gradua*:es  and 
General  Adult  Learners:  Age 


IT  Graduates 
(N"75) 

4.0% 
25.3 
44.0 
22.7 

4.0 


Adult  Learners* 
(N''744) 

20* 

17% 

21 

15 

20 


Difference 
(in  %) 

-16.0 

+8.3 
+23.0 

+7.7 
-16.0 


*The  adult  learner  age  grouping  reported  by 
Aslanian  and  Brickell  (1980)  were  25-29, 
30-34,  35-44,  45-54,  and  55  and  older. 
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Table  5 

A  Comparison  of  IT  Graduates 
And  General  Adult  Learners:    Marital  Status 


Marital 
Status 


IT  Graduate 
(N  -  75) 


Adult  Learner 
(N  -  744) 


Difference 
(In  Z) 


Married 
Single 
Divorced 
Widowed 


69.3 
16.0 
10.7 
4.0 


67.0 
14.0* 
10.0 
9.0 


+2.3 
+2.0 
+.7 
-5.0 


♦Includes  separated  (27,)  and"  never  married,  single 


Table  6 

A  Comparison  of  IT  Graduates  and 
General  Adult  Learners:    Highest  Degree 

IT  Graduates  Aduit  Learner  Difference 

Education  (N  -  75)  (N  -  744)  (In  7,) 

Bachelor's  Degree  0  I30Z  -13.0 

Master's  38.7 

M.A.+  Additional  Hours  17.3  12.0  +85.3 

Ed.  Spec.  Certificate  28.0 

Doctorate  13.3 


ERIC 


630 

624 


Appendix  D 


A  Description  of  the 
IT  Academic  Programs 

Table  9     Undergraduate  Majors 

of  the  WSU  IT  Graduates  (1980-85) 

Table  10    A  Description  of  the  IT  Program 
Core»  the  4  tracks,  and  the 
Frequency  of  Course  Election 
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Table  9 

Undergraduate  Majors  of 
The  WSU  IT  Graduates  (1980-85) 

Major                                      Frequency  Z  of  Respondents 

Education                                      38  50.7 

Liberal  Arts                                 25  33.4 

English  or  Humanities      '8  10.7 

Social  Science                    .5  6*7 

Speech  Communications              4  8*3 

Computer  Sci,  Math,  or  Eng.     4  5^3 

Psychology                               2  2.7 

Natural  or  Physical  Sci           2  2*7 

Nursing  or  other  Medical  Area  6  8.0 

Business  Administration           2  2.7 

Other                                      2  2.7 
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Table  7 

A  Comparison  of  IT  Graduates 
and  General  Adult  Learners:    Employment  Status 


Employment 
Status 


IT  Graduates 
(N  -  75) 


Adult  Learners 
(N  -  744) 


Difference 
(  in  Z) 


Employed 

Retired 

Homemaker 

Studeni: 

Unemployed 


93.3 

1.3 
I. .3 
2.7 


71.0 
9 

15.0 
2.0 

3 


+22.3 

-13.7 

-  .7 

-  .4 


*Data  not  gathered 


Table  8 

A  Comparison  of  Male  and  Female  IT  Graduates 
and  Female  Adult  Learners:    Ages  of  Children 

Female 

All  IT  Graduates       Adult  Learners  Difference 

Ages  of  Children  (N  -  75)  (N  -  792)  (in  7,) 

Under  5  20. OZ  8,0%  +12. OZ 

6-18  53.4  39.0  +14.4 

over  19  25.3  59.0  -33.7 
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Table  10 


A  Description  of  the  IT  Program 
Core,  the  4  tracks,  and  the 
Frequency  of  Course  Election 


Percentage  of 

Program 

Course 

Respondents  who 

Category 

Number  and  Name 

Elected  the  Course 

Core  Group 

IT  711  Instructional  Design 

90.77 

IT  710  Intro.  Graduate  Seminax 

84.0 

IT  714  Seminar  In  Computer 

62.7 

Assisted  Instruction 

IT  715  Educ^  Product  Eval. 

61.3 

IT  611  Systems  Applications 

60.0 

In  Education  Planning  & 

Management 

Track  1 

EER  763  Fund*  of  Statistics 

33. 3Z 

IT  811  Adv.  Instruc.  Design 

28.0 

Doctoral 

IT  815  Needs  Assessment 

28.0 

IT  810  Program  Design 

26.7 

IT  818  Readings  in  IT 

18.7 

IT  911  Adv.  Research  Seminar 

16.0 

IT  915  Educational  Futures 

12.0 

IT  816  Adv.  Instruc.  Management  9.3 

EER  864  Variance  &  Covariance 

8.0 

IT  910  Issues  in  IT 

6.7 

EER  865  Multivariate  analysis 

5-3 

Track  2 

IT  712  Instructional  &  Organ- 

54.7 

izational  Instruction 

Private  Sector 

IT  812  Practicum 

40.0 

Training 

IT  716  Computer-Managed 

36.0 

Instruction 
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Percentage  of 

Program 

Course 

Respondents  who 

Category 

Number  and  Name 

Elected  the  Course 

Track  3 

IT  510  Using  Audiovisual  Methods 
Materials  and  Equipment 

28-0 

IT  512  Instructional  Materials 

21.3 

Workshop 

Media 

IT  519  Light,  Sound,  Space  and 
Mot*ion 

9-3 

IT  513  Computer  Programmed 

6-7 

Multi-*Image  Presentations 

Track  4  IT  613  Individualizing  50. 7Z 

Instruction 

School-Oreinted        IT  616  Management  of  Instruction  44.0 

IT  511  Educational  Technology  42.7 

IT  512  Instructional  Materials  21.3 
Workshop 
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^Append! 

On-the-job  U«e  of  IT  Skills 

Table  II    Competency  Categories 
Ranked  in  Teras  of 
Frequency  of  Use  on  the  Job 

Table  12    Ranking  of  Most  Used  and 
Least  Used  Competencies 
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Table  11 

Competency  Categories  Ranked  in  Terms  of  Frequency 
Of  Use  on  the  Job 


Competency  Category  Average  Ranking  of  Competencies 

!•  Design  8,9 

2.  Analysis                          '  16.2 

3.  Assessment  &  Evaluation  23*8 

4.  Communication  25*2 

5.  Management  39.8 

6.  Development  45,3 
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Table  12 

IT  Competencies  Ranked  in  Order 
of  Frequency  of  Use  on  the  Job 


Rank  Competency  Average  Competency 

!•    Define  your  goals  4.7 

2.  Write  behavior'  1  objectives  4.7 

3.  Select  Appropriate  Media  4.5 

4.  Sequence  Content  4.6 

5.  Evaluate  Instructional  materials  4.5 

6.  Sequence  Learning  Activities  4.5 

7.  Design  group  instruction  '*  4.5 

8.  Design  lessons  4.6 
9*  Design  programs  ^^.3 
10.  Analyze  &  evaluate  existing  4.2 

instructional  systems 


47.  Write  role  play,  case  study,  sim.  3.6 

48.  Write  a  funding  proposal  3.4 

49.  Develop  learning  games  3.6 

50.  Write  workbooks  4.1 
51*  Produce  mediated  instruction  3.3 

52.  Design  computer-managed  instruction  3.3 

53.  Write  sound-slide  .scripts  3.2 

54.  Write  audioscripts  3.1 

55.  Write  multi-image  scripts  2.8 

56.  Write  videodisk  scripts  2.7 
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THE  EFFEfTS  3F  COMPUTER  ANIMATED  ELABORATION  STRATEGIES  AND  PRACTICE 
ON  FACTUAL  AND  APPLICATION  LEARNING  IN  AN  ELEMENTARY  SCIENCE  LESSON 


ABSTRACT 

The  purpose  of  this  study  v/as  to  examine  the  effects  of  animation  and  practice  on  factual  and 
application  learning  in  computer-based  instruction  (CBI).  Also  studied  was  the  extent  to  which 
animation  and  practice  promoted  near  and  far  transfer  of  these  learning  outcomes.  Subjects  consisted 
of  192  elenientiay.school  students.  The  GBI  content  was  an  elementary  physics  lesson  in  Newtonian 
mechanics.  Two  levels  of  Practice  (Relevant  Prabtice,  Inelevant  Practice)  were  crossed  with  three 
levels  ofjGraphic  Type  (Graphic,  Animated  Graphic,  No  Graphic)  and  two  levels  of  Text  Type  CText, 
No  Text).  No  significant  differences  were  foand  for  the  between-bubjects  factors  of  Practice, 
Graphic  Type,  and  Text  Type.  Among  the  within-subject  factors  (Learning  Outcome,  Transfer)  a 
main  effect  was  found  for  transfer  subjects  performed  significandy  better  on  far  transfer  questions 
than  near  transfer  questions.  A  significant  interaction  was  detected  between  Learning  Outcome  and 
Transfer  far  learning  was  facilitated  for  factual  learning,  whereas  no  difference  in  transfer  was 
detected  for  application  learning. 


INTRODUCTION 

Instructional  design  has  evolved  into  a  complex  science  involving  tiie  manipulation  of  many 
instructional  variables.  Effective  delivery  of  instruction  has  consistentiy  been  the  focus  of  much 
attention  in  instructional  design.  The  recent  availability  of  microcomputers  has  provided  designers 
with  many  instructional  alternatives  as  well  as  the  need  to  consider  important  instructional  decisions. 
The  potential  of  the  computer  as  an  effective  instructional  delivery  system  has  been  carefully  reviewed 
and  studied  (see,  for  example,  Edwards,  Norton,  Taylor,  Weiss  &  Dusseldorp,  1975; 
Bangert-Drowns,  Kulik,  &  Kulik,  1985,  and  Qark,  1985). 

Con^iiter  technology  affords  designers  with  a  myriad  of  useful  design  options.  Features 
such  as  imnoediate  and  informative  feiedback^  lesson  branching,  lesson  management,  and  visuals  have 
been  discussed  and  reviewed  in  lengti).  Designers  can  also  effectively  incorporate  a  wide  range  of 
teaching  strategies  and  activities  into  compl  ler-based  instructicm  (CBI). 

Potentially  unique  features  of  CBI  have  been  discussed  axyi  debated.  Some,  such  as  Gaik 
(1983),  have  cauticmed  against  concentrating  too  heavily  on  the  features  of  any  one  particular 
medium.  Clark  has  asserted  that  virtually  £dl  results  found  in  CBI  research  stem  from  purely 
instructicmal  variables  and  are  only  indirectiy  associated  with  the  computer.  Although  controversy 
remains  (see,  Peticovich  &  Tennyson,  1984  vs.  Claik,  1983),  it  appears  clear  that  many  features  of 
the  computer  des^e  greater  attention  among  researchers.  Animation  is  one  such  feature  wMch  can 
be  more  easily  incoiporated  into  CBI  than  p^aps  other  delivery  systems.  Although  instruction 
t/pically  uses  animation  as  an  extrinsic  motivate,  th^  is  a  need  to  investigate  the  use  of  animation  to 
direcdy  or  indirectiy  support  or  enhance  instruction.  An  example  of  computer  animation  used  directiy 
in  instruction  is  an  animated  block  accelerating  down  an  inclined  plane  to  teach  a  concept  in  a  physics 
class.  Recmt  research  on  tiie  effectiveness  of  animation  as  an  aid  to  instniction  has  failed  to 
demonstrate  that  animation  improves  learning  (see,  for  example,  A.  Caraballo,  1985;  J.  Caraballo, 
1985;  King,  1975;  Moore,  Nawrocki,  &  Simutis,  1979;  Riel>er&  Hannafin,  in  press). 

The  lack  of  empirical  support  fcH*  animation  presents  an  apparent  discrepancy  between 
hypothesized  animation  effects  (as  supported  by  a  theoretical  perq)ective  of  the  importance  of 
providing  information  in  verbal  and  visual  rq)resentations  to  promote  redundant  encoding)  and  die 
empirical  evidence  to  date.  Research  in  the  area  of  cognitive  psychology  points  to  the  apparent 
retrieval  advantages  of  multiple  encoding  at  the  time  of  learning.  Mental  imagery  researchers  (Bower, 
1972  and  Paivio,  1979)  have  recognized  mental  imagery  as  one  of  the  primary  mental  structures, 
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along  with  verbal  representations.  Many  studies  (Bower,  1972;  Paivio,  1979;  Dwyer,  1978)  point  to 
the  power  of  pictures  over  abstract  wordis  for  purposes  of  higher  levels  of  retention.  The  problem 
seeois  to  rest  in  the  need  to  define  appropriate  contexts  where  the  potentially  powerful  visual  effect  of 
aniriation  can  be  used  most  effectively* 

Practice  is  uiiother  instructional  variable  which  has  been  studied  extensively  (Anderson  & 
Biddle,  1975;  Hamaker,  1986).  Practice  in  CBI  typically  comprises  a  series  of  questions  presented 
during  or  following  instruction.  CBI  practice  serves  thr&efuxtioris:  1)  to  establish  and  maintain 
attention;  2)  to  facjlita^  encoding;'and  3)  to  provide  cq)pfntunities  for  rehearsal  (Wager  &  Wager, 
1985).  The  af)plicatibn  of  practice  questions  during  CBI  is  based  on  tiie  adjunct  questioning  lesearch 
of  Rothkopf  (1966)  and  others.  CBI  studies  have  shown  that  practice  can  be  a  very  powerfol 
influence  cm  student  achievement  (Hannafin,  Phillips,  Rieber,  &  Gariiart,  in  press;  Hannafin, 
Phillips,  &  Tripp,  1986).  Although  practice  is  a  proven  and  robust  instructional  technique,  even 
current  reviewers  caution  against  sweeping  gcneralizaticms  (see  Hamaker,  1986).  There  is  a  need  to 
study  the  efifects  of  cbniputerized  pnu^tice,  especially  when  used  in  the  presence  of  other  complex 
instructional  techniques,  such  as  animation. 

There  were  ty/o  primary  purposes  to  this  study:  1)  examine  the  effects  of  animation  and 
practice  on  factual  and  applicaticxi  learning  in  a  CBI  lesson;  and  2)  investigate  the  extent  to  which 
animation  and  practice  promoted  near  and  far  transfer  of  these  learning  outcomes.  It  was 
hypothesized  that  students  provided  with  verbal  and  graphic  elaborations  of  lesson  content  would 
achieve  hi^er  posttest  scores  than  groups  receiving  only  verbal  or  only  graphic  elaborations.  It  was 
further  hypotiiesized  that  practice  would  be  of  greatest  value  where  the  elaboration  support  was 
minimal. 


The  subjects  consisted  of  192  fourth,  fifth,  and  sixth  graders  from  a  rural  public  elementary 
school.  Participation  was  voluntary  and  selection  based  on  parent  consent  The  subjects  represented 
a  typical  cross-section  of  elementary  school  students.  In  addition,  three  fifth  grade  classes  from 
another  public  school  s^ed  as  a  pilot  subjects  to  validate  the  materials  as  well  establish  reliability  on 
the  instruments. 

CBI  Lesson  Content 

The  CBI  lesson  used  as  the  instmctional  content  for  this  study  was  first  developed  for  a 
previous  study  (see  Rieber  &  Hannafin,  in  press).  This  lesson  described  and  explained  Isaac 
Newton*'i  Laws  of  Motion.  Tic  i  lesson  material  was  divided  into  four  parts:  1)  introductory  material; 
2)  motion  resulting  fix>m  equal  ibrces  in  opposite  directions  in  one  dimensioned  space;  3)  motion 
resulting  from  unequal  forces  in  opposite  (tirections  in  one  dimensional  space;  and  4)  motion  resulting 
from  equal  and  unequal  forces  in  two  dimensional  space. 

The  first  lesson  part  introduced  tiie  learner  to  Isaac  Newton's  formal  discovery  of  certain 
physical  laws.  *rhis  part  also  initiated  the  sequence  of  le?jning  activities  used  for  the  rest  of  the 
lesson.  Most  of  the  information  presented  in  the  first  part  was  factual  in  natixrc;  The  second  part 
introduced  tiie  concept  tiiat  equal  but  opposite  forces  are  neected  to  cause  objects  to  stop.  This  section 
dealt  only  with  one-dimensional  space,  iae  third  part  expanded  this  notion  to  include  the  effects  of 
unequal  forces  acting  upon  a  stationary  object  The  final  direction  and  speed  of  an  object  is  a 
combination  of  all  of  the  forces  from  both  directions.  The  third  part  also  presented  these  concepts  in 
one-dimensional  space.  Finally,  tiie  fourth  part  added  the  notion  of  two-dimensional  space  to  the 
above  concepts.  Again,  the  final  direction  and  speed  of  the  object  results  systematically  from  the 
sequence  of  forces  which  acted  upon  it. 

All  instmction  was  presented  at  an  introductory  level  with  the  technical  descriptions  of  the 
forces  of  gravity  and  friction  removed.  Approximately  45  minutes  was  required  to  complete  the 


METHODS 


Subjects 


642 


636 


Animation  4 


lesson. 

Lesson  Versions 

Elaboration  strate^es  were  embedded  at  various  locations  within  the  lesson*  The  locations 
of  these  elaboration  strategies  were  determined  by  the  performance  of  students  in  a  pilot  study/  Hie 
elaboration  strategies  wctc  added  to  the  Kssm  in  areas  found  to  be  the  most  difficult  and  needing 
addidcmal  instruction.  Two  factors  (Text  Type,  Graphic  Type)  were  used  to  determine  the  nature  of 
the  embedded  elaboration  strategies:  two  levels  of  Text  (Text,  No  Text)  were  crossed  with  three 
levels  of  Graphic  (Graphic,  Animated  Cirq)hic,  No  Graphic).  The  comlnnation  of  these  two  factors 
gave  the  following  treatment  permutations:  text  only,  text  plus  graphic,  text  plus  animated  grq)hic, 
graphic  only^  animated  graphic  only,  no  text/no  graphic. 

The  text  and  grq)hic  factors  wc^e  crossed    a  practice  factor  with  two  leveis  (Relevant 
Practice,  Irrelevant  Practice).  Relevant  practice  consisted  of  four  multiple-choice  questions  after  each 
of  the  four  less9n  parts:  two  factual  and  two  application.  Feoiback  in  the  form  of  knowledge  of 
correct  icnults  was  provided  ^relevant  practice  OMisisted  of  a  noninstructional  activity  which 
required  approximately  the  same  time  to  ccxnplete  as  the  relevant  practice.  The  fomiat  of  the 
noninstmcticmal  activity  was  also  multiple-choice  questions,  however,  the  questions  concerned 
information  which  was  irrelevant  to  the  lesson  content. 

Dependent  Measures 

BiSttCSt  A37-item  posttest  was  developed  which  consisted  of  two  types  of  questions:  16 
facir"  .  and  21  application.  Tliese  learning  outcomes  correspond  to  verbal  information  and  rule-using, 
respectively,  as  defined  by  Gagne*  (1977).  A  multiple-choice  question  format  (1  answer  and  4 
distractors)  was  used  to  test  the  above  learning  outcomes.  All  test  questions  were  presented  to  the 
students  by  computer. 

A  total  of  19  questions  measured  near  transfer  and  18  questions  measured  far  transfer  9 
factual  questions  and  10  application  questions  measured  near  transfer;  7  factual  questions  and  1 1 
application  quv  stions  measured  far  transfer.  An  example  of  near  transfer  would  be  a  question 
presented  in  the  context  of  a  ball  being  kicked  An  example  of  &r  transfer  would  be  a  question 
presaited  using  a  wooden  block  instead  of  a  ball.  Overall  test  reliability,  as  determined  during  the 
pilot  study,  was  .91.  Content  validity  was  established  by  an  expert  panel  review.  ; 

Student  processing  time.  The  tinie  required  by  students  to  process  each  of  the  instructional 
frames  was  also  collected  Processing  time  was  measured  as  the  time  taken  by  students  to  press  a 
key  to  continue  after  a  screen  prompt  had  been  givm.  Response  time  was  calculated  by  the  computer 
and  rounded  to  the  nearest  second. 

Procedures 

In  order  to  determine  the  content  validity  and  reliability  of  the  materials  as  well  as  to 
substantiate  the  instructional  design  of  the  materials,  a  pilot  study  was  conducted  using  a  small 
sample  of  fifth  grade  students.  In  this  pilot  study,  the  four  instmctional  parts  (introductory,  ^ual 
forces  in  one  dimension,  unequal  forces  in  one  dibtnension,  and  unequal  forces  in  two  dimensions) 
were  presented  in  an  all-text  form  without  any  embedded  elaboration  strategy.  Data  from  this  pilot 
study  was  used  to  determine  the  validity  and  reliability  of  the  test  items  in  order  to  help  determine  the 
final  selection  of  appropriate  test  items.  Also,  this  data  was  used  to  determine  wherc  supplemental 
instruction  in  the  form  of  the  elaboratim  strategies  was  most  needed  by  students. 

In  the  main  experiment,  students  were  randomly  assigned  to  one  of  the  12  treatment 
conditions.  All  treatments  and  data  were  delivered  and  recorded  by  computer.  On  average, 
approximately  45  minutes  was  necessary  to  complete  the  lesson. 

Design  and  Data  Analysis 

In  this  study  a3X2X2X(2X2)  completely  crossed  factorial  design  was  used.  Three 
between-subjects  factors  (Graphic  Type,  Text  Type,  and  Ptactice)  were  crossed  with  two 
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within-subjects  factors  (Learning  Outoxne,  TVansfcr).  The  between-subjccts  ractors  consisted  of: 
Graphic  Type  (Graphic,  Animated  Graphic,  No  Graphic);  Text  Type  (Text,  No  Text);  and  Practice 
(Relevarit  Practice,  Relevant  Practice).  The  within-subjectsfaaors  consisted  of:  Learning  Outcome 
(Fact,  Applicatiai);  arid  Transfer  (Near,  iFar).  A  mixed  factor  analysis  of  variance  (ANOVA)  was 
chosen  as  an  appropriate  statistical  procedure  for  the  study.^  This  analysis  is  commonly  known  as  a 
repeated  measures  analysis  of  variance  (Wmer,  1971).  The  two  within-subjccts  factors  also  served 
as  the  dependent  measures  of  die  posttest 

hi  addition  to  the  above  analysis,  a  second  post  hoc  analysis  of  student  processing  latency  of 
the  17  instructional  fiames  which  contained  embedded  elaboration  strategies  was  conducted  usmg 
ANOVA  procedures. 


Learning  Effects 

^  The  percentage  means  and  standard  deviations  of  posttest  scores  are  contained  in  Table  1. 
No  main  effects  were  found  for  Graphic  Type,  E(2,180)=.393,  ii=.676.  Text  Type,  E(l,180)=.072, 
IL^.789,  or  Practice,  E(1480)=.234,  ii=.629.  No  main  effect  was  found  for  Learning  Outcome, 
E(1480)=2.285,  ^=.132.  A  rnam  effect  was  found  for  Transfer,  E(l»180)=4.439,  b=  037:  learners 
perforoK^  significantly  better  on  far  transfer  questions  than  near  transfer  questions. 

No  interactions  were  detected  amcxig  the  between-subjects  factors  (Chaphic  Type,  Text 
Type,  Practice).  However  a  significiint  interaction  was  found  for  the  witfun-subjects  factors 
(Learning  Outcome,  Transfer),  E(l,180)=!3.91 1,  ji=.05.  The  lesson  promoted  far  learning  for  factual 
information,  whereas  far  learning  was  not  facilitated  for  die  acquisition  of  application  learning.  A 
moderately  significant  interaction  was  found  between  the  factors  of  practice  and  learning  outcome, 
E(l,180)=3.394, 5=.067.  When  provided  with  practice,  students  performed  significantiy  higher  on 
application  questions  than  factual  questions. 


Processing  Time 

Means  and  standard  deviations  for  the  total  processuig  time  of  the  17  instructional  frames 
which  contained  embedded  elaboration  strategies  are  listed  in  Table  2  by  treatment  Once  prompted  to 
press  a  key  to  proceed,  students  spent  significantiy  less  tinoe  viewing  lesson  fiames  which  contained 
animated  graphics  as  compared  to  instmction  vMch  contained  either  graphic  or  no  graphics, 
E(2,184)=45.66,  ii<0p01.  Also,  and  not  surprisingly,  students  spent  significantiy  more  time 
viewing  lesson  frames  which  contained  additional  tactual  elaborations  as  compared  to  students  who 
were  not  given  additional  textual  support^  E(lil84)=27.29,  p<:.0(X)l.  Apparentiy,  students  were 
taking  the  time  to  read  all  textual  information  presented 

A  significant  interaction  was  detected  between  die  presence  of  graphics  and  text, 
E(2,184)=3.61,  c=.029.  J^tudents  attended  longer  when  no  graphic  accompanied  additional  text. 


RESULTS 


Insert  Table  1  About  Here 


644 

638 


Animation  6 


Insert  Table  2  About  Kfeie 


DISCUSSION 

The  lack  of  main  effects  among  the  embedded  elaboration  conditions  was  suiprising* 
Previous  research  has  demonstrated  the  power  of  pictures  over  abstract  words  in  facilitating 
understending  of  abstract  concepts*  Some  mental  imagery  researchers  have  posed  that  information  is 
encoded  into  long  term  memory  in  two  ways:  as  a  mental  image  and  as  a  vcAal  iwprcsentation 
(Paivio,  i979).  It  was  believed  that  learners  wcmld  reckU  greater  amounts  of  factual  information  as 
well.as  be  more  successful  in  solving  application  questions  when  provided  with  instruction  which 
contained  both  graphic  and  textual  elabcM:ation  cues  than  when  no  such  cues  werc  provided  or  when 
these  cues  provided  only  graphic  or  only  textual  information*  The  results  from  this  study  showed 
that  this  was  not  the  case* 

There  arie  several  possible  explanations  for  the  outcomes  found  in  this  study*  First,  it  is 
possible  that  the  students  did  not  atterul  to  the  elaboration  strategies*  That  is,  although  the  elaboration 
strategic  provided  ^e  potential  for  additional  cognitive  processing  of  the  lesson  information,  the 
students  did  not  make  use  of  it  Reasons  for  fliis  are  debatable*  An  analysis  of  the  processing  latency 
for  the  lesson  frames  shows  tfiat  students  spent  significantty  more  time  viewing  lesson  frames  which 
contained  textually  oriented  elaboration  strategies  than  similar  frames  which  did  not  contain  this 
textual  information*  This  data  implies  that  although  the  learners  took  IcHiger  to  view  frames  with 
textually  oriented  infonnation,  they  did  not  use  the  information  in  an  elaborative  manner*  Students 
spent  significantly  less  time  viewing  frames  which  contained  animated  graphic  elaboration  strategies 
than  those  with  ^phics  or  no  graphics*  Instead  of  taking  additional  time  to  think  about  (elaborate) 
oc  mentally  reconstruct  the  animated  sequence,  the  learners  immediately  pressed  a  key  to  trigger  the 
presentation  of  the  next  lesson  frame*  When  the  elaboraticHi  strategy  was  presented  in  static  form 
(graphic  with  or  without  text),  )eamd:s  spent  a  considerably  longer  time  viewing  the  frame*  The 
differences  in  processing  time  indicates  thalt  the  learners  were  processing  the  elaboration  strategies  in 
different  ways,  but  no  thresholds  for  increased  learning  occulted*  It  shoiild  be  noted  that  although 
equal  amounts  of  learning  occurred,  less  cognitive  processing  time  was  used  by  the  animated  graphic 
group,  hence  the  potential  for  more  efficient  learning*  The  drawback  is  that  the  animation  sequence 
takes  morc  time  to  present  than  either  static  graphics  or  all-text  presentations*  Instead  of  attending  to 
the  animated  ihistruction,  students  may  have  ignored  it  and  spent  the  time  readmg  other  texraal 
material  on  the  screen* 

Another  probable  explanation  concerns  the  naturc  of  the  lesson  content  The  lesson  material 
may  have  proved  too  difficult  and  complex  for  die  students*  This  level  of  complexity  could  have 
prevented  learners  from  mentally  processing  the  elaboration  strategies  in  the  ways  in  which  they  were 
intended*  It  could  have  been  that  the  embedded  elaborations  were  instnictionally  too  weak  to  affect 
learning,  especially  given  the  difficulQr  of  the  tasks*  Since  the  elabwatioh  strategies  were  not 
included  in  die  validation  process,  it  is  difficult  to  make  inferences  about  dieir  effects* 

The  significant  difference  between  near  and  far  transfer  learning  is  soniewhat  surprising* 
Typically,  learning  in  near  transfer  situations  would  be  expected  to  be  greater  than  far  transfer 
situations*  Oat  explanation  is  that  die  concepts  were  encoded  meanin^ully  into  ''real  life"  contexts. 
These  contexts  were  natural  extensidhs  of  die  'lacked  ball''  analogy  used  in  die  lesson*  This  rationale 
also  helps  to  explain  die  significant  interaction  between  learning  outcome  (Fact,  Application)  and 
transfer*  htamtrs  performed  significandy  better  on  factual  questions  in  far  transfer  settings  dian  on 
application  questions  in  near  transfer  settings*  The  impUcation  is  that  learners  were  actively 
elaborating  on  the  ball  exaniple  in  simple,  factually  related  ways  and  never  fiilly  processed  die 
inform^on  in  order  to  use  it  in  solving  application  questions.  Jf  the  elaboration  strategies  had  been 
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effective,  as  hypothesized,  more  consistent  findings  would  have  been  expected 

The  lack  of  main  effects  foe  practice  was  also  surprising*  Again,  this  result  is  probably  an 
artifact  of  the  task  difficulty  -  the  lesson  material  was  probably  too  complex  for  the  age  group*  The 
practice  activities  were  intended  to  provide  c^poxtunities  f(x  students  to  process  relevant  lesson 
content  These  activities  should  have  helped  to  simplify  the  lesson  material  in  order  to  help  students 
select  relevant  cbntoit  Furthermore,  die  activities  should  have  encouraged  organization  and 
integration  of  content  widi  pnor  knowledge  and  other  lesson  content  Rather,  they  appesred  to 
increase  the  cognitive  strain  imposed  on  the  students*  Students  probably  perceivol  the  lesson  as  too 
demanding  and  may  have  chosen  to  ignore  pptential  practkx^  benefits*  Anodier  explanation,  thou^ 
less  likely,  suggests  that  insufficient  practice  was  provided  Asking  students  only  four  questions 
after  approximately  11  computer  fi^tmes  may  have  been  insufficient  to  activate  actequato  processing. 
No  general  interpretations  of  the  usefulness  of  practice  as  an  instructional  technique  should  be 
infoitd  The  effectiveness  of  adjunct  questions  as  practice  strategies,.under  certain  guidelines,  has 
been  well  documented  (Hamaker,  1986;  Salisbury,  Richards,  &  Klein,  1985;  Wager  &  Wager, 
1985)* 

Although  an  interaction  between  practice  and  elaboration  strategy  was  expected,  no 
interaction  was  observed  It  was  expected  that  when  learners  were  provided  good  elaborative  cues  to 
facUitate  approfniate  imagery  and  verbal  encoding,  they  would  not  rely  on  the  cognitive  processes 
activated  by  routine  practice*  Conversely,  in  the  absence  of  the  lesscm  cues  believed  to  facilitate 
apprq>riate  levels  of  encoding,  other  techniques,  such  as  practice,  would  be  necessary  to  achieve 
similar  encoding  levels*  The  absence  of  this  interaction  is  also  probably  attributable  to  previous 
explanations:  either  the  students  did  not  attend  to  the  lesson  information  appropriately,  or  the  lesson 
material  was  too  difficult 

This  study  has  raised  several  questions  concerning  the  relationship  between  student  thought 
processing,  instmctional  delivery  systems,  and  instructional  strategies.  Due  to  an  apparent 
confounding  caused  by  difficult  lesson  content  compounded  by  relatively  ineffective  lesson  activities, 
the  question  of  how  computer  animation  may  be  used  to  positively  affect  learning  remains  largely 
unanswered  Future  researchers  should  be  careful  to  ad^uately  match  the  complexity  of  materials 
with  the  maturity  of  the  subjects.  Also,  replications  should  systematically  validate  the  effectiveness 
of  additional  elaborations*  Lessons  should  be  designed  to  direct  the  learner  to  both  attend  to,  and 
use,  elaboration  strategies  appropriately. 
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47.25 

Graphic 

SD 
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44.38 
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Type 

Practice 
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Graphic 

Yes 

M 

46.75 

46.94 

46.88 

41.07 

SD 

26.45 

27.46 

24.42 

18.47 

No 

M 

46.75 

48.69 

43.13 

47.25 

SD 

23.48 

24.45 

24.42 
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M 
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56.63 

49.38 

55.12 
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SD 

28.54 

29.51 
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No 

M 
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48.75 

45.00 
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21.74 
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15.86 
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No 
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49.50 

48.63 
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25.34 

28.08 

20.66 

24.44 

Notes:  n-16  subjects  per  cell. 
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Mean  Processing  Time  (in  Seconds^  and  Standard  rteviarinns  of  17  Instrucrional  Frames 
Containing  Embtdded  Elaboration  Strategies 
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Graphic  Type 
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SD 
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Animated  Graphic 

M 
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SD 
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No  Graphic 

M 
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Rhonda  S.  Robinson 
Lina  D.  Ong 
Dept«  of  L.E.P.S./Instructional  Technology 
Northern  Illinois  University 
DeKalb,  Illinois 

Abstract 

The  field  of  educational  technology  developed  in  the  1940 's  out  of  several 
theoretical  constructs,  including  perception,  communication,  and  the  psychology 
of  learning.  The  basis  of  the  primary  research  in  educational  technology  was  a 
combination  of  behavioral  psychology  and  systems  theory.  Because  of  this  early 
orientation,  most  research  in  educational  technology  from  1940-1980  followed 
experimental  paradigms  which  attempted  to  show  causality  and/or  relationships  :.n 
testing  the  effectiveness  of  visual  media  for  instruction. 

Mote  recently,  researchers  and  scholars  in  educational  technology  have 
recommended  widening  the  field  to  include  more  diversity  of  method  and  topics 
for  study.    Current  researchers  and  educational  technology  doctoral  students  are 
being  encouraged  to  investigate  new  questions  and  to  consider  various 
alternative  methods  of  investigation.    Ethnographic,  descriptive,  historical, 
and  analytic  me':hods  are  all  being  recommended  to  help  answer  questions 
involving  how  any  given  medium  is  structured  to  make  meaning,  how  a  medium  mal:^s 
its  impact,  and  what  the  scope  of  the  impact  has  been. 

This  study  explores  some  current  ateas  of  research  in  educational 
technology  and  defines  the  non-experimsiltal  research  methods  which  can 
appropriately  be  used  to  investigate  these  topics.    If  new  questions  are  .0  be 
researched  in  non-traditional  ways,  scholars  need  guidance  and  assistance  to 
create  a  new  thrust  of  programmatic  research  in  educational  technology.  The 
proposed  continuation  of  this  study  could  result  in  a  reference  guide  which 
compiles  research  topics/  methods,  and  sample  studies  to  provide  the  guidance 
needed. 
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Naturalistic  Inquiry  in  Educational  Technology 

Rhonda  S.  Robinson 
Lina  D.  Ong 
Dept.  of  L.E.P.S. /Instructional  Technology 
Northern  Illinois  University 
DeKalb,  Illinois 


Introduction 

Emerging  as  a  separate  field  in  the  1940*s,  Educational  Technology  drew 
upon  theory  bases  from  psychology,  learning,  and  perception.    The  field  was 
derived  primarily  from  behavioral  and  cognitive  psychology,  and  consequently 
based  its  seminal  research  on  strict  experimental  models  appropriate  to  the 
early  questions  and  hypotheses  developed.    Media  was  tested  experimentally,  and 
found  (at  the  time)  to  be  effective. 

In  the  forty  yeai s  of  research  that  followed,  the  same  experimental 
paradigm  predominated.    New  media  were  tested  against  old,  characteristics  of 
learners  and  specific  media  were  compared,  and  relationships  between  learners 
and  media  were  explored,  all  using  various  accepted  experimental  designs. 

More  recently,  the  field  has  broadened  its  definition  to  include 
instructional  design,,  media  analysis,  and  learner  attitudes  among  other  topics. 
Researchers  are  asking  a  variety  of  new  questions,  many  of  which  would  be 
difficult  to  examine  using  traditional  experimental  methods. 

Background  and  Rationale 

Currently,  most  of  the  published  scholarship  in  educational  technology  has 
been  based  upon  experimental  and  descriptive  studies.    The  leading  researchers, 
those  who  train  future  scholars  in  research  methods,  have  only  recently  begun  to 
accept  a  full  range  of  research  methodologies  for  educational  technology. 
Consequently,  educational  technology  journals  publish  few  studies  based  upon 
non-experimental  designs.    Since  reports  of  alternate  methodologies  are  few, 
researchers  in  educational  technology  have  only  the  models  of  research  reports 
in  other  fields  to  assist  them  in  research  design  and  reporting. 


The  experimental  "bias"  in  educational  technology  has  been  questioned  by 
many  researchers  seeking  to  expand  the  areas  of  scholarship  in  the  field. 
Becker  (1977)  recommended  alternate  nethodologies  to  approaching  educational 
technology  research.    Cochrane,  et  al.  (1980)  suggested  that  researchers  base 
new  areas  of  inquiry  on  "the  ethnography  of  situations  in  which  people  use 
visual  materials  (an  anthropological  approach)"  (p.  247).    They  stressed  the 
importance  of  recognizing  that  visual  learning  is  a  cultural  phenomenon  and 
should  be  studied  with  techniques  and  analyses  appropriate  to  cultural 
processes.    Heinich  (1984)  in  his  N.I.E.  funded  ten  year  review  paper  encouraged 
researchers  to  engage  in  more  "naturalistic"  inquiry.    "Through  the  use  of 
naturalistic  inquiry,  I  am  sure  we  will  discover  important  factors  . . . 
that  have  been  ignored  too  long  ..."  (p.  84).    Heinich  also  argued  that  such 
research  should  be  encouraged  in  dissertation  work  and  should  be  more 
disciplined  and  more  perceptive  than  experimental  studies. 


654 


h.ERJC 


I 


Alternative  methodologies  would  lead  the  field  of  educational  technology  to 
new  questions,  and  to  often  ignored  areas  such  as  the  impact  of  educational 
technologies  on  social  relationships  and  educational  institutions*    Kerr  (1985) 
suggested  that  methods  drawn  from  sociology,  policy  sciences,  and  anthropology 
could  **shed  new  light  on  problems  that  have  traditionally  been  approached  using 
psychological  research  methods**  (p*  4)*    Kerr  felt  that  asking  new  questions  in 
less  traditional  ways  was  critical  to  the  future  of  education*  * 

With  such  recommendations  for  alternative  methods,  why  has  the  field  not 
adequately  responded?    In  a  symposium  presentation  at  the  1986  Association  for 
Educational  Communication  and  Technology  Conference,  Becker,  Heinich,  and  other 
researchers  offered  their  explanations:    Many  strong  researchers  believe 
experimental  research  is  vital  and  best;  most  new  scholars  are  encouraged  to 
design  only  experimental  studies;  alternate  methodologies  are  fairly  unfamiliar 
to  the  field  and  so  are  less  acceptable  to  dissertation  directors  and  journal 
editorial  boards;  and  studies  which  employ  case  or  ethnographic  methods  are  more 
difficult  to  synthesize  into  a  journal  length  format*    This  same  panel 
recommended  research  using  philosophical,  historical,  and  developmental  inquiry, 
semiotic  and  content  analysis  techniques,  r.nd  several  anthropological  methods 
including  case  study  and  participant  observation* 

In  summary,  psychological,  experimentally  based  research  has  formed  the 
basis  of  educational  technology  scholarship*    Recent  d'^velopments  in  research 
and  theory  generation  have  resulted  in  recommendations  for  new  question  areas 
and  alternate  research  methodologies*    For  several  years,  such  suggestions  have 
been  proffered,,  and  attempts  to  follow  them  have  been  reported*  Symposia 
featuring  non-experimental  reports  have  been  presented  at  the  Conference  of  the 
Association  for  Educational  Communications  and  Technology  (Mclsaac,  Robinson, 
and  Koetting,  1984}  and  elsewhere,  but  the  methods  recommended  have  not  gained 
widespread  use  or  familiarity* 

There  are  numerous  books  available  which  detail  research  designs  and 
statistical  procedures.    Herrian  and  Simpson  (1984)  have  added  to  the  usual 
texts  by  presenting  a  ^full  range  of  methodology  for  doing  research,  and  by 
supporting  points  with  examples  from  research  studies  done  with  adults  in  adult 
settings**  (p*  iii)*    It  is  fjust  this  sort  of  reference  which  is  required  by 
educational  technology  researchers  to  encourage  and  guide  them  to  new 
techniques*    The  problem  araas  and  theory  basis  of  educational  technology  needs 
to  be  expanded,  and  a  reference  guide  could  provide  motivation  and  assistance* 

Purpose 

This  project  will,  when  completed,  have  followed  several  steps  necessary  to 
the  creation  of  an  alternate  research  guide  for  educational  technology 
researchers*    It  will,  specifically: 

-  review  the  types  of  research  recommended  for  future  educational  technology 
issues  and  concerns; 

-  review  the  non-experimental  methodologies  recommended  by  many  scholars  to 
enhance  educational  technology  research; 
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-  describe  and  discuss  reported  studies  which  have  used  non-experimental 
research  techniques  in  educational  technology; 
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-  develop  guidelines  for  theory,  issues,  and  research  questions  appropriate 
to  non-experimental  educational  technology  research;  and 

-  seek  out  and  develop  examples  or  models  of  studies  utilizing  alternate 
methods,  and  discuss  their  reportage. 

Methodology 

The  procedures  necessary  to  the  completion  of  this  study  include  the 
following: 

1.    A  review  of  the  last  decade  of  instructional  technology  research  would 
concentrate  on  problem  areas,  topics,  and  appropriate  questions  as  well  as 
research  designs*    As  noted  in  the  background  section,  several  scholars  have 
been  reviewing  and  critiquing  the  educational  technology  research  literature. 
Direction  would  be  taken  from  their  recommendations  for  future  educational 
technology  research, 

2«    A  survey  of  ^naterials,  texts,  compiled  readings,  etc.  used  by  major 
educational  technology  academic  programs  to  help  students  gain  research  skills 
in  their  field  would  be  conducted •    IJnivers ity  programs  willing  to  cooperate  in 
such  a  compilation  would  be  asked  to  respond  to  a  survey  (see  Appendix  1), 

3.  A  review  of  recommended  alternate  methodologies,  including  their 
definitions,  advantages  and  disadvantages,  and  appropriate  implementation. 
Texts  such  as  Isaac  and  Michael  (1981)  and  Merriam  and  Simpson  (1984)  would  be 
drawn  from  and  a  bibliography  for  further  study  would  be  recommended. 

4.  A  discussion  of  the  emerging  problem  areas  for  educational  technology 
research  would  be  synthesized,  and  the  appropriate  methods  for  their 
investigation  would  be  recommended* 

5.  Several  (6-8)  recent  studies  would  be  located  as  models'  of  reported 
non-experimental  educational  technology  research. 

With  these  purposes  and  methods  in  mind,  a  report  of  the  first  two  steps  in 
the  methodology  of  this  project  follows.    This  is  a  preliminary  report  of  a  work 
in  progress,  with  the  expectation  that  others  hearing  or  reading  the  report  will 
offer  ideas,  suggestions,  argument,  or  research  articles  to  p.rovids  models  for 
others. 

Review  qI  Research.  1976-1986 

An  examination  of  articles  published  in  ECTJ  and  JID  for  this  period  was 
undertaken  with  three  major  focus  points:  topic  areas,  methodologies,  and 
research  questions.    Also  of  interest  were  the  discussion  sections,  especially 
the  areas  of  recommended  future  research.    These  f jcus  areas  will  after  further 
review  provide  the  answers  to  several  questions,  such  as:    what  has  been  the 
research  in  educational  technology?   What  methodologies  have  been  chosen  to 
answer  what  questions?   Which  topics  have  attracted  the  most  research,  and  what 
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areas  have  been  recommended  for  more  investigation?    What  conclusions  can  be 
drawn  about  the  use  of  experimental  and  "alternate**  methods  of  research  in 
educational  technology? 

First  to  emerge  were  subject  areas  which  allowed  the  organization  of  this 
compilation  of  our  recent  research  history*    The  following  areas  emerged,  as 
they  have  been  defined  and  exemplified* 

1.  Visual  Literacy  -  includes  studies  on  visual  cuing  strategies,  physiological 
effect  of  cuing  (e.g.  scanning  behavior,  eye  moveme*  t);  various  pictorial 
attributes,  effects  of  visualization,  and  individual  differences  variables 
(picture-style  preferences,  pictures-interpretation  behavior  of  children). 
Example  of  study:    Responsiveness  of  Nigerian  students  to  pictorial  depth 
cues* 

2.  Instructional  Development  -*  includes  studies  which  addressed  and/or  have 
implications  for  instructional  media  design/development;  studies  which 
developed  models  for  message  design,  presentation,  production  and 
instructional  methods/approaches . 

Example:    Supplementing  traditional  instruction  with  objective-based 
instructional  development. 

3.  Computers  -  CAI,  CBI,  computers  in  education  and  industry. 

Example:    Computer-based  foreign  language  instruction:    Improving  student 
attitudes . 

4.  Learning  Strategies  -  studies  on  mnemonic  strategies,  imagery,  and  other 
learning  or  cognitive  strategies  such  as  rote  and  networking;  visual  and 
verbal  information  processing. 

Example:    Information  processing  from  screen  media:    a  psycholinguistic 
approach. 

5.  Learner  Characteristics  -  types  or  learners,  learner  preferences, 
motivation,  orientation,  abilities,  attitudes,  etc. 

Example:    Interaction  between  student  achievement  orientation,  locus  of 
control,  and  two  methods  of  college  instruction. 

6.  Media  Utilization/Attributes  -  media  symbol  systems,  coding,  media  use  in 
education,  media  selection.  ^ 

Example:    A  survey  of  school  teachers*  utilization  of  media. 

Certainly  there  may  be  some  other  possible  topic  areas,  or  alternate 
definitions;  however,  those  chosen  were  considered  valid  and  helpful  for  our 
discussion. 

Tables  1,  2,  and  3  review  the  number  of  articles  reviewed,  by  topic  and  by 
methodology,    (insert  tables  about  here).    As  shown,  the  most  common  topics  were 
computers  in  education,  instructional  development,  visual  literacy,  media 
attributes/utilization, and  learning  strategies.    As  expected,  experimental 
research  was  by  far  the  most  prevalent,  with  any  of  the  other  methods  cited  only 
rarely. 
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0£  non-experimental  methods,  the  most  often  used  was  survey,  and  surveys 
were  most  often  found  necessary  in  the  topic  area  of  computers.    Perhaps  with 
the  introduction  of  a  fairly  new  technology,  surveys  were  necessary  to  determine 
use  patterns  and  adoption  practices*    The  topic  area  that  was  investigated,  using 
the  widest  range  of  methods  was  instructional  development.    While  most  research 
reports  cited  experimental  method,  case/field  study,  survey,  and  descriptive 
methods  were  also  used.    The  delphi  technique,  naturalistic  methods,  and 
evaluation  studies  as  well  as  theory  development  were  also  reported. 

Overall,  the  review  of  research  topics  and  methodologies  provided  few 
surprises.    Experimental  methods  were  used  most  often,  and  were  reported  in  all 
topic  areas  except  mass  media  and  training.    ''Qualitative'*  research  methods  were 
much  more  rare.    Descriptive,  historical  and  philosophic  approaches,  the  more 
commonly  accepted  methods,  accounted  for  only  12  research  reports.  Case/field 
study,  delphi,  and  naturalistic  methods  were  cited  in  only  18  studies.  The 
experimental  models  were  obviousl:.'  found  to  be  the  most  useful  and  viable  for 
the  last  10  years. 

Survey  Results 

The  survey  was  introduced  at  the  annual  P.I.D.T.  conference  in  Bloomington, 
Indians,  and  the  mailing  list  for  the  meeting  was  used  for  initial  selection  of 
respondents.    The  A.E.C.T.  Human  Resources  directory  was  also  consulted,  as  was 
the  Educational  Media  yearbook.    Of  the  almost  60  university  programs  offering 
master's  and  doctoral  degrees,  30  were  selected  for  participation  in  this 
survey.    In  addition,  a  letter  of  intent  and  the  survey  were  published  in  che 
R.T.D.  Newsletter,  with  an  open  request  for  information  from  other  programs. 

Of  this  representative  group,  twenty  surveys  were  returned,  19  from 
university  programs  and  one  from  a  corporate  training  center.    Responses  herein 
discussed  were  from  these  programs:    Arizona  State,  Brigham  Young,  Colorado- 
Denver,  Florida  State,  Indiana,  Iowa  State,  Kent  State,  Manitoba,  Minnesota, 
Oklahoma,  Ohio  State,  Pennsylvania  State,  Texas  A  &  M  ,  and  Washington,  among 
others . 

The  six  questions  on  the  survey  were  intended  to  elicit  information  about 
the  research  course  requirements  in  the  program,  the  research  methods  taught, 
the  books  used^  the  expectations  of  the  department  (if  any)  as  to  type  of 
research  encouraged,  and  the  current  topics  being  researched  by  faculty  and 
students  at  the  institution.    A  copy  of  the  survey  is  included  as  Appendix  1. 
The  survey  was  useful  in  a  number  of  ways.    First,  it  served  to  call  attention 
to  this  area  of  interest,  non-experimental  research,  and  discover  what  interest 
and  expertise  other  faculty  have  in  the  area.    Second,  it  provided  a  list  of 
texts  currently  used  or  recommended  for  teaching  research  skills.    Third,  it 
revealed  that,  while  encouraging  students  to  conduct  research  using  "whatever 
method  appropriate  to  their  question",  most  programs  responded  negatively  to 
current  research  being  done  using  non-experimental  methods.    There  were  several 
responses  that  declared  interest  in  this  topic,  but  very  few  that  displayed  much 
expertise  or  practice  with  the  "alternate"  methods  of  conducting  research  or 
even  posing  questions. 

Specifically,  then,  the  survey  provided  the  following  responses.  All 
programs  responding  had  required  research  courses  for  doctoral  students,  and 
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many  had  such  courses  for  master's  students  as  well.    Host  of  these  courses  were 
taught  by  faculty  other  than  instructional  systems  faculty,  usually  in  the 
educational  psychology  program.    Consequently,  respondents*  familiarity  with  the 
course  content  was  not  as  instructor  nor  designer  of  these  courses.  Eight^ 
programs  had  their  own  course  or  courses  in  instructional  systems  research, 
usually  seminars  for  doctoral  students.    Texts  required  for  these  basic  research 
courses  included  those  by  Kerlinger,  Borg  and  Gall,  McMillan  and  Schumacher, 
Dwyer,  Best,  and  Tuckman. 

Of  the  programs  responding  to  question  3.,  only  eight  hai  a  separate  course 
or  unit  highlighting  non^experimental  research  methods.    Texts  used  in  these 
courses  included  those  by  Bogdan  and  Bikleu,  Miles  and  Haberman,  Spradley, 
Patton,  Willis,  and  Cuba  and  Lincoln.    These  texts  consider  qualitative  research 
in  education,  naturalistic  inquiry,  and  ethnographic  methods  of  research. 

Almost  all  programs  responded  that  students  are  encouraged  to  conduct 
research  appropriate  to  their  question,  but  ten  programs  encourage  experimental 
methods  first,  and  seven  programs  responded  that  they  encourage  "alternate" 
methods.    Many  programs  reported  that  students  are  advised  to  seek  out  courses 
in  other  university  departments  which  could  assist  them  in  gaining  skills  in 
non-experimental  research,  such  as  anthropology  or  sociology.    Only  one  program 
had  a  full  course  in  "alternate"  methods,  a  seminar  at  Florida  State.  Other 
programs  such  as  the  one  at  N.I.U.  reported  that  students  in  instructional 
systems  seminars  are  provided  materials  and  readings  in  n^^n-experimental 
research  since  the  required  educational  psychology  research  courses  teach  them 
experimental  methods  and  statistics. 

Several  programs  listed  current  research  topics  being  investigated  in  both 
experimental  and  non-experimental  studies.    These  included: 


experimental:    videodisc  instruction 
persuasion  and  media 
model  and  theory  building 
expert  systems 
effects  of  CAI 
computerized  testing 


non-experimental:    use  of  distance  technology 

effects  of  r.icrocomputers  on  student  7interaction 
importance  of  university  film  and  video  collections 
reactions  to  high  school  classes  taught  by  satellite 
computers  in  highsr  education 
television  production 
dissemination  of  technology 
product  development  and  evaluation,  techniques 
and  model  development. 

Methodologies  for  these  non-experimental  studies  included  survey,  delphi 
technique,  meta-analysis,  case  study,  participant  observation,  literary 
criticism,  film  criticism, interview,  and  multiple  qualitative  methods.    The  list 
was  a  substantial  enough  one  to  expect  that  some  of  these  studies  would  derive 
information  reportable  at  conferences  and  publishable  in  future  journal  volumes. 
From  these  responses  it  could  be  summarized  that  the  interest  in  "alternate" 
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methodologies  is  substantial  and  possibly  increasing*    Several  respondents 
remarked  that  faculty  or  students  were  interested  but  unfamiliar  with  such 
research.        think  the  more  naturalistic  approaches  are  much  more  suited  for 
instructional  technology  than  the  harder,  quantitative  ones,"  is  a  quotation 
that  characterizes  such  interested  respondents.    Overall,  the  survey  provided 
the  expected  information:    lists  of  courses,  one  syllabus,  several  text 
recommendations,  and  topic  areas  currently  being  investigated  both 
experimentally  and  non-experimentally.    Interest  in  the  "alternate** 
methodologies  was  also  evident  from  the  responses. 

With  sections  cab  and  two  of  the  methodology  of  this  project  having  been 
discussed,  the  question  is,  what  next?    Obviously,  a  more  thorough  review  of  the 
currently  reported  topics  and  methodologies  will  reveal  the  questions  and  the 
results  of  the  research  reviewed  (1976-1986) •    This  review  will  provide  a  more 
detailed  look  at  the  currant  state  of  research  in  instructional  technology:  the 
purpose,  the  results  and  the  need  for  future  research. 

Also,  this  ten  year  review  will  summarize  the  recommendations  made  in  the 
several  "review"  or  "critique"  articles  which  have  critically  analyzed  the 
research  over  the  last  ten  years  and  made  suggestions    for  future  topic  areas 
and  metiiodologies.    These  articles  should  prove  useful  for  the  development  of  a 
list  of  topic  areas  and  emphases  considered  appropriate  for  the  future. 

In  addition  to  the  above  review  of  research,  a  review  of  the  topics  and 
methodologies,  purposes,  results,  and  recommendations  will  be  completed  for  the 
last  several  years  using  Dissertation  Abstracts  and  the  R.T.D.  Proceedings  as 
primary  sources.    Uhen  theL3  steps  ar3  completed,  a  fairly  total  picture  of  the 
current  research  should  be  drawn.    Topic  areas,  methods,  questions,  results,  and 
future  recommendations  when  compiled  will  provide  a  clear  picture  of  the  current 
state  of  research  in  instructional  technology.    The  consideration  of  future 
topics  and  methods  can  be  then  situated  in  a  full  review  of  the  recent  past. 

Another,  more  controversial  step  also  remains  in  this  project.  A 
discussion  and  definition  of  available  "alternate"  methods  of  research  must  also 
include  the  question  of  the  prevailing  paradigm  under  which  our  research  is 
conducted.    There  is  a  large  difference  between  recommending  surveys  or 
interviews  or  even  observation  and  recommending  that  the  field  consider  a 
paradigm  other  than  the  scientific  paradigm  now  guiding  our  research.  Several, 
presentations  at  our  A.E.C.T.  conferences  have  made  clear  the  need  for  the  field 
to  grow  in  new  directions;  a  growth  made  possible  only  by  the  posing  of 
essential  questions  in  new  frameworks.    A  new  science  nod^i  has  been 
recommended,  as  has  an  artistic  model  (Eisner)  or  a  semiotic  model  (Barthes), 
among  others.    This  question  of  paradigm  shift  must  be  discussed  and  resolved  as 
we  move  into  the  1990 's  and  our  research  moves  into  new  arenas. 

The  non-scientific  paradigm  can  be  productively  used  to  develop  new  areas 
and  methods  of  research  in  instructional  technology.    Methods  such  as  linguistic 
analysis,  phenomenology,  case  study,  grounded  theory,  action,  participation, 
observation,  and  simulation  can  all  be  "borrowed*^  from  other,  well-defined  and 
developed  disciplines  and  applied  to  our  field.    These  methods  are  not 
considered  "soft"  in  other  fields,  and  have  as  their  advantage  the  development 
of  breadth  and  depth  of  research  not  possible  in  the  experimental  methods. 
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The  survey  and  research  review  both  shoved  an  increased  interest  in  non- 
experimental  research.    Less  clear  is  the  acceptance  of  a  true  paradigm  shift  in 
instructional  technology  research.    A  different  type  of  question  could  and 
should  be  posed,  according  to  many  in  our  field*    This  project  proposes,  when 
finished,  to  discuss  both  the  paradigm  shift,  the  '^alternate'*  methods  it  would 
necessitate,  and  the  various  data  gathering  techniques  available  to  researchers, 
regardless  of  the  paradigm  being  used.    It  is  hoped  that  through  the  completion 
of  this  project,  enough  evidence  of  quality  research  methodologies,  topics,  and 
questions  will  be  derived  to  provide  future  researchers,  and  the  professors  who 
teach  them,  with  helpful  guidelines  to  alternative  research  in  our  field. 
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Naturalistic  Inquiry  In  Educational  Technology 

Recently,  researchers  and  scholars  In  educational  technology  have  recommended 
widening  the  field  to  Include  more  diversity  of  method  and  topics  for  study.  We 
are  being  encouraged  to  Investigate  new  questions  and  to  consider  various 
alternative  methods  of  investigation.    Ethnographic,  descriptive,  historical,  and 
analytic  methods  are  all  being  reccmmended  to  help  answer  quest.ions  involving  how 
any  given  medium  is  structured  to  make  meaning,  how  a  medium  makes  its  impact,  and 
what  the  scope  of  the  impact  has  been.    If  new  questions  are  to  be  researched  in 
non-traditional  ways,  scholars  need  guidance  and  assistance  to  create  a  new  thrust 
of  programmatic  research  in  educational  technology.    My  work  will  result  in  a 
reference  guide  which  compiles  research  topics,  methods,  and  sample  studies  to 
provide  the  guidance  needed. 

This  proposed  project  (full  proposal  available  upon  request)  requires  information 
from  the  varied  programs  around  the  country  teaching  research  skills.    Your  help 
is  greatly  appreciated. 

Please  answer  for  your  program,  to  the  be  it  of  your  knowledge. 

1.    is  there  a  separate  course  or  unit  which  discusses  research  methods? 
Name  of  course?  EnroDment? 


2.    Does  this  course  survey  several  research  methods? 
What  text(s)  are  required?  Recommended? 


3.    If  \  separate  course  or  unit  f-aught  which  highiights  non-experimental 

.earch  methods?    Which  methods  are  included?    Wnat  text(s)  are  used?  Who 
teaches  this  course? 


4.    Are  ;::a8ter8  or  doctoral  students  encouraged  to  investigate  questions 
experimentally?    Are  "alternate"  inquiry  methods  encouraged? 


5.    Have  any  students  recently  completed  studies  which  employed  alternate  research 
methods?    Topics  explored?    Methods  chosen? 


6.    Please  list  the  research  topicCs)  or  area(s)  currently  being  explored  by 
yourself  and/or  your  students.    Include  research  methodology  utilized. 
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As  some  of  you  are  aware,  I  am  undertaking  a  study  on  research 
methodologies  in  educational  technology.    My  goal  1^  to  create  a 
reference  text  which  compiles  research  topics,  methods,  and  sample 
studies  for  scholars  who  may  want  to  use  non-traditional  research 
methods  in  their  investigation  of  new  questions  in  educational 
technology •    In  this  regard  I  am  conducting  a  survey  of  academic 
programs  that  teach  research  skills •  -  If  you  have  not  already 
participated,  please  provide  the  requested  information  pertaining  to 
your  program  (survey  follows).    Your  help  in  this  survey  is  highly 
appreciated. 

Please  return  the  survey  to  me  at  the  address  below.    Thank  you  for 
professional  cooperation. 

Sincerely, 


Rhonda  S.  Robinson 

Associate  Profeisor 

Northern  Illinois  University 

Dept.  of  LEPS- Instructional  Technciogy 

DeKalb,  IL  60115 
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Text  Density  and  Learner  Control  as  Design  Variables 
With  CBI  and  Print  Media 


Instructional  designers  frequently  ignore  the  unique  properties  of 
catputer-based  instruction  (CBI)  by  creating  materials  using  the  same 
design  fomats  and  teaching  strategies  traditionally  incorporated  in 
print  lessons  (Bork^  1985;  Burke^  1982).    One  important  difference 
between  the  two  media  lies  in  the  constraints  that  CBI  imposes  on  the 
display  of  instructional  text  .(Grabinger,  1983;  Hartley,  1985;  1987; 
Lancaster  &  Vferner,  1985;  Richardson,  1980) .    Specifically,  computer 
text  offers  considerably  less  flexibility  than  print  by:    (a)  limiting 
the  visible  display  to  one  page  at  a  time,  (b)  making  backward  paging 
for  review  purposes  more  difficult,  (c)  limiting  the  sizG  of  the  page 
layout  to  about  24  lines  and  4P-'80  characters,  and  (d)  offering 
limited  cues  regarding  lesson  length. 

Recognizing  these  properties,  instructional  desigiiers  generally 
advocate  formats  that  minimize  clutter  and  maximize  "white  space"  in 
the  display  area  (Allessi  &  Trollip,  r>85;  Bork,  1985;  Burke,  1982; 
Caldwell,  1980;  Heines,  1984;  Tullis,  1981).    One  popular  system  for 
spacing  text  is  "chunking"  (Basse tt,  1985;  Grabinger,  1983) ,  which 
involves  separating  sentences  into  meaningful  thought  units  with  blank 
spaces -surrounding  each.    Chunking  and  similar  methods,  however,  have 
failed  to  show  clear  advantages  under  either  print  or  CBI 
presentations  (cf,  Bassett,  1985;  Carver,  1970;  Feibel,  1984;  Gerrell 
&  Mason,  1983;  Hartley,  1987;  O'Shes"  &  Sindelar,  1983).    A  possible 
limitation  is  that  they  leave  lesson  content  unaltered  while 
presenting  it  in  an  unfamiliar  format. 

The  main  interest  in  the  present  research  was  varying  lesGon 
content  in  accord  with  attributes  of  the  presentation  media  onployed. 
Of  specific  concern  was  the  level  of  "richness"  or  detail  provided  in 
instructional  text,  an  attribute  we  will  label  text,  "density  level." 
In  earlier  research  with  print  naterial,  Reder  and  Anderson  (1980; 
1982)  compared  corop?ete  chapters  from  college  textbooks  with  summaries 
of  main  points  on  both  direct  and  indirect  questions.    In  10  separate 
studies,  summaries  were  found  to  be  comparable  or  superior  for 
learning  tu.  the-original  text.    The  authors  conclu.^ed  that  summaries 
may  help  students  to  isolate  central  ideas  without  the  distraction  of 
having  to  attend  to  unimportant  details.    Similar  to  the  Reder  and 
Anderson  (1980)  study,  the  present  conception  of  text  density  level 
concerned  such  attributes  as  length  of^terials  (number  of  words 
used)v^  redundancy  of  explanations,  and  depth  of  contextual  support  for 
important  concepts.    This  construct  resembles  what  reading  researchers 
have  labeled  the  "microstructure"  of  text  (Davison  &  Kantor,  1982),  as 
contrasted  with  "macrostructure"  which  concerns  how  information  is 
organized  and  elaborated  through  comparison  of  examples,  nonexamples, 
and  concept  categories  (Di  Vesta  &  Finke,.  1985;  Prayer,  Fredrich,  & 
Klausmier,  1969;  Moes  et  al.,  1984;  Reder,  Charney,  &  Morgan,  1986). 
An  examp!    of  a  low-density  frame  and  a  parallel  high-density  frame 
from  the  present  instructionl  materials  is  presented  in  Figure  1. 
Note  that  the  low-density  version  contains  the  same  information  as  the 
conventional  version  but  eliminates  details  and  nonessential  words. 
The  result  is  approximately  a  50%  reduction  in  both  number  of  words 
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and  screen  area  required*    One  hypothesis  in  the  present  study  was 
that  such  low-density  narrative  would  promote  better  learning  and  more 
favorable  attitudes  on  CBI  lessons  by  reduiig  reading  and  cognitive 
processi,  ^  demands  of  screen  displays. 


Insert  Figure  1  about  here 


A  second  research  interest  was  the  nature  and  effects  of  learner 
preferences  for  different  density  levels  in  print  and  CBI  modes* 
Although  "learner-control"  strategies  that  allow  students  to 
self-determine  instructional  conditions  have  shown  positive  results  in 
some  studies  {Judd,  Bunderson,  ^-Bessent,  1970),  recent  findings  have 
more  often  been  negative  (Carrier,  Davidson,  &  WilliamSr  1985;  Carrier 
&  Sales,  1985;  Fisher,  Blackwell,  Garcia,  &  Greene,  1975;  Lahey  & 
Crawford,  1976;  Ross  &  R^kow,  1981;  Tennyson,  1980).    Studies  of 
Aptitude-treatment  interaction  (ATI)  effects  further  suggest  that  the 
less  the  student* s  prior  knowledge,  the  less  eff^tive  learner-control 
tends  to  be  (Carrier  &  Sales,  1985;  Fisher  et  all.,  1975;  Gay,  1986; 
H^nnaf  in,  1984;  Ross  &  Pakow,  198]^;  1982;  Tennyson,  1980)  •    To  extend 
this -research,  we  explored  the  viability  of  allowing  learners  to  make 
selections  of  text  density  level,,  which  unlike  the  variables  of  task 
length,  quantity,  and  difficulty  emphasized  in  previous  studies, 
r^resents  a  contextual  rather  than  primary  lesson  property* 
Low-density  computer  text  was  expected  to  be  a  more  popular  choice 
than  the  high-density  versions  due  to  the  relative  difficulty  of 
reading  text  frcm  CRT  screens*    These  questions  were  examined  by 
crossing  two  presentation  modes  (computer  vs.  print)  with  three  text 
density  conditions  (high,  low,  and  learner  control) •  Dependent 
variables  were  different  types  of  learning  achievement,  lesson 
completion  time,  attitudes,,  and  learning  efficiency. 


Method 

Subjects  and  Design 

Subjects  were  48  undergraduate  teacher  education  majors  enrolled 
in  a  beginning  instructional  technology  course.    They  were  assigned  at 
random  to  six  treatment  groups  in  which  learning  materials  were^ 
presented  in  either  of  two  modes  (computer  or  print)  under  one  of 
three  'f^xt  density-level  conditions  (high,  low,  learner  control). 

Materials 

Profile  data  form.    A  brief  questionnaire  was  used  to  determine 
subjects'  attitudes  toward  mathematics  jnd  CBI.    Ratings  were  recorded 
on  five-point  Likert-type  scales,  with  "5"  representing  the  must 
positive  reaction. 

Instructional  Unit.  The  learning  material  wab  .an  introductory 
unit  on  central  tendency.    The  unit,  which  was  organised  into  five 
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Instructional  Unit>    The  learning  material  was  an  introductory 
unit  on  central  tendency.    The  unit,  which  was  organized  into  five 
sections,  eraj^iasized  the  teaching  of  facts  and  conceptual  information 
that  students  would  need  to  recall  to  solve  and  interpret  problems.  A 
conventional  (high-density)  print  version  of  the  lesson  was  initially 
prepared.    Total  length  was  18  ^^ages  and  2/123  words.    Within  each 
section  the  basic  instructional  orientation  involved  defining  the 
concept  or  main  idea  and  then  illustrating  its  application  with 
several  rontext-based  numerical  examples. 

Following  Reder  and  Anderson's  procedure,  low-density  text  was 
systematically  generated  from  the  conventional  text  by  (a)  first 
defining  a  set  of  general  rules  for  shortening  the  material,  (b) 
having  at  least  two  people  discuss  the  rules  and  rewrite  the  materials 
accordingly,  and  (c)  reviewing  the  material  and  making  changes  until 
consensus  was  achieved  that  all  criteria  were  satisfied.  Specific 
rules  employed  were: 

1.  Reduce  sentences  to  their  main  ideas. 

a.  Remove  any  unnecessary  modifiers,  articles,  or  phrases. 

b.  Split  complex  sentences  into  single  phrases. 

2.  Use  outline  form  instead  of  paragraph  form  v*iore  appropriate. 

3.  E)elete  sentences  that  sunnnnarize  or  amplify  without  presenting 
new  information. 

4.  Present  information  in  "frames"  containing  limited  amountis  of 
new  information,  as  in  programmed  instruction. 

The  completed  low-density  lesson  consisted  of  1,189  words,  a  56% 
savings  relative  .to  the  high-density  version,  and  15  pages,  a  17% 
savings  (see  samples  in  Figure  1) .    CBI  versions  of  the  high-  and 
low-density  lessons  were  prepared  directly  from  the  print  materials. 
Word  counts  for  corresponding  low-  and  high-density  versior  >  were 
identical  across  print  and  ccnputer  modes.    Due  to  the  much  smaller 
display  area  of  the  computer  screen,  it  was  not  possible  or 
(considered  desirable)  to  duplicate  the  print  page  formats?:.  Computer 
frames  were  thus  designed  independently,  using  what  were  subjectively 
decided  to  be  the  most  appropriate  screen  layouts  for  presenting  the 
material.    Each  screen  provided  both  back-  and  forward-paging  options. 
The  final  versions  of  the  low-  and  high-density  CBI  lessons  consisted 
of  49  and  66  frames,  respectively. 

Attitude  survey.    Attitude  items  consisted  of  statements  about  the 
learning  experience  to  which  subjects  indicated  levels  of  agreement  or 
disagreement  on  a  5-point  Likert-type  scale  (e.g.,  1  "strongly 
disagree,"  5  ~  "strongly  agree").    Abbreviated  descriptions  of  the  six 
statements  comprising  the  survey  are:  "Lesson  moved  quickly," 
"Material  was  interesting,"  "vWos  easy  to  learn,"  "Explanation  was 
sufficient,"  "Text  layout  was  easy  to  read,"  and  "Prefer  this  method 
over  lectiare."    Internal  consistency" reliability  for  the  survey, 
computed  by  Cronbach's  alpha  formula,  was  £  =.63  (  n  =  48). 
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Achievement  posttest>    The  achievewient  post test  (print  format) 
consisted  of  four  sections  designed  to  assess  different  types  of 
learning  outcomes.    The  first  two  sections  were  considered  knowledge 
subtests,  since  each  assessed  recognition  or  recall  of  information 
exactly  as  it  af^ared  in  tlie  text.    The  knowledge-l  subtest 
("definitions")  contained  17  multiple-choice  i terns ^  each  consisting  of 
a  statement  describing  one^  aV  ,  or  none  of  the  three  central  tendency 
measures  (mean;  modef  or  median) .    Those  that  described  central 
tendency  measures  included  the  exact  key  words  contained  in  both  low- 
and  high-density  narratives.    The  knowledge-2  subtest 
("distributions")  contained  eight  questions  concerning  the  effects  of 
syitmetrical  and  skewed  distributions  on  the  placement  and 
interpretatiCii  of  the  mean  and  the  median.    On  four  of  the  items 
subjects  were  asked  to  write  a  brief  rationale  for  their  answers.  The 
distributions  shown  on  all  items  were  exacc  replications  of  examples 
that  appeared  in  the  lesson. 

The  calculation  subtest  contained  five  problems  requiring 
computation  of  diffei.ent  central  tendency  measures  from  new  data  not 
used  in  lesson  examples.    The  transfer  subtest  consisted  of  13  items 
that  involved  interpreting  how  central  tendency  would  vary  with 
changes  in  distributions  or  individual  scores.    Items  of  this  type 
were  not  included  in  the  lesson,  nor  were  the  underlying  principles 
needed  to  answer  those  items  explicitly  stated.    They  were  thus 
considered  measures  of  transfer  (or  conceptual)  learning. 

Scoring  rules  on  objective  items  and  calculation  problems  awarded 
one  Doint  for  a  correct  answer.    On  interpretative  items  one  point  was 
awarded  for  a  correct  answer  and  an  additional  point  for  a  correct 
explanation.    Internal  consistency  reliabilities  were  conputed  by 
means  of  the  KR-20  formula  for  subtests  with  dichotomous  ittin  scores 
and  by  Cronbach's  alpha  formula  for  the  remainder.    A  summary  of 
resultant  reliability  values  along  with  subtest  length?^  and  maximum 
points  is  as  follows;    knowledge-l  (17  items,  17  points,  r  =.60), 
knowledge-2  (8  items,  12  points,  £=.57),  calculation  (5  items,  5  ' 
points,  X  =.67)  and  transfer  (13  items,  20  points,,  t  =.84) . 

Procedt^re 

Subjects  completed  the  profile  data  fc     Juring  a  regular  class 
^mieeting,  at  which  time  they  signed  up  to  receive  the  learning  task  the 
following  week.   .Typically  from  3-15  subjec  ts  attended  an  individual 
session.    Two  similar  classrooms  were  used,  one  for  the  print 
condition  and  the  other  for  the  CBI  condition.    Tne  latter  classroom 
contained  12  Apple  He  coitputers  with  monochrome  screens,  either 
,single  or  double  disk  drives,  and  from  64K  to  128K  of  memory. 
Proctors  began  the  session  with  instructions  for  completing  the  task. 
Instructions  for  all  treatments  indicated  that  (a)  the  five  units  were 
to  be  studied  at  one's  own  pace,  (b)  turning  back  to  reread  preceding 
pages  (frames)  was  permitted  if  desired,  and  (c)  a  posttest  would  be 
given  following  the  learning  task.    Subjects  in  the  learner-control 
treatment  received  additional  instructions  indicating  that  depending 
on  how  much  explanation  they  desired,  they  could  choose  between  "long" 
and  "short"  presentations  on  each  section.    To  help  the  subject  make  a 
decision  for  the  first  section,  actual  samples  of  parallel  low-  and 
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high-density  pages  were  shown.    In  the  computer  condition^  subjects 
pressed  a  key  to  indicate  their  preferences^  following  which  the 
appropriate  high-  or  low-density  version  of  the  unit  was  presented. 
In  the  print  condition^  preferences  were  indicated  <^rally  to  the 
proctor  who  then  distributed  appropriate  materials.    The  same  density 
selection  procedures  were  repeated  at  the  beginning  of  each  of  the 
remaining  four  sections.    After  subjects  completed  the  last  section, 
their  finish  tiroes  were  recorded  and  the  attitude  suivey  was 
administered  followed  by  the  posttect. 


Results 

The  basic  statistical  design  was  a  2 (presentation  mode)  x 
3  (density  condition)  factorial.    An  alpha  level  of  .05  was  used  to 
j'xSge  significance.    Trea*Tnent  means  and  standard  deviations  on  major 
dependent  variables  are  summarized  in  Table  1. 


Insert  Table  1  about  here 


Initial  2x3  ANOVAs  were  conducted  on  responses  to  the  profile 
data  survey  to  judge  the  equivalence  of  trealjnent  g^roups  prior  to  the 
administration  of  experimental  tasks.    No  significant  main  effects  or 
interactions  were  found  on  any  of  the  items. 

Learner-Control  Selections 

Preliminary  analyses  were  made  of  density- level  selections  by 
learner-control  subjects.  Results  for  CBI  and  print  groups  combined  (n 
=16)  showed  that  low-density  and  high-density  materials  were  selected 
with  equal  frequency  (both  M*s  =  2.5)  across  the  five  sections. 
Low-density  material r  however ,  was  selected  an  average  of  3.75  times 
(and  high-density  1.25  times)  by  print  subjects,  whereas  the  exact 
oK>osite  pattern  occurred  for  the  CBI  group  (low-density  M  =  1.25; 
high-density  M  =  3.75).    The  differential  showing  greater  low-density 
preferences  Hy  the  print  group  was  significant,  t(14)  =  2.57,  £  <  .05. 

Achievement  Results 

Analyisis  of  scores  on  the  knowledge-1  subtest  ("definitions") 
showed  a  significant  main  effect  of.  presentation  mode,  F  (1,  42)  = 
4.48,  £  <  .05.    Subjects  in  the  print  condition  (  M  =  13.1;  77% 
correct)  scored  higher  than  chose  in  the  CBI  condition  (  M  =  11.6;  68% 
correct).    Neither  the  density  level  effect  nor  the  interaction  was 
significant. 

The  ANOVA  .performed  on  calculation  subtest  scores,  showed  the 
main  effect  of  presentation  mode,    F  (1,  47)  =  10.08,  £  <  .02,  to  be 
the  only  significant  outcome.    As  on  the  knowledge-1  test,  the  print 
group  (  M  =s  4.0;  80%  correct)  surpassed  the  computer  group  (  M  =  3.1; 
62%  correct) .    No  significant  ma-'n  ot  interaction  effects  were  found 
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on  either  the  knowledge-2  or  transfer  subtests • 

Lesson  Coapletion  Time  and  Learning  Efficiency 

The  analysis  of  lesson  completion  time  yielded  a  highly 
significant  presentation  mode  main  effect^  F  (1^  42)  =  26.65^  £  < 
•001;  and  a  marginally  significant  density-level  main  effect,  F  (2^ 
42)  =  2.53^  £  <  •10,    The  presentation  mode  effect  was  due  to  print 
subjects'  taking  significantly  less  time  (  M  =  18,0  min*)  to  complete 
the  lesson  than  did  CBI  subjects  (  M  =  32.3  minO-    The  ordering  of 
density-level  groups  was  as  expected^  with  low-density  lowest  (  M  = 
20.8  min.)^  learner-control  next  (  M  =  26.9  min.)^  and  high-density 
highest  (  M  =  27.8  min.) .    The  specific  comparison  between  high-  and 
low-density  levels  is  attentuated^  however^  by  the  inclusion  of  the 
learner-control  treatment  which  represented  a  mixture  of  the  two 
variations.    When  the  learner-control  treatment  was  excluded  fron^  the 
analysis^  the  time  savings  for  the  low-density  groups  reached 
significance^  F  (1^  427)  =  4.30^  £  <  .05c 

A  desired  outcome  of  adaptive  instructional  strategies  is  to 
improve  learning  efficiency^  as  measured  by  the  level  of  achievement 
attained  per  instructional  time  allocated.    Accordingly,  as  in  several 
previous  studies  on  adaptive  instruction  (Ross  &  Rakow,  1981;  Tennyson 
&  Rothen,  1977),  treatments  were  compared  on  efficiency  scores, 
computed  as  the  ratio  of  posttest  total  score  divided  by  lesson 
completion  time.    The  ANOVA  results  showed  the  instructional  mode  main 
effect  to  be  the  only  significant  source  of  variance.  Efficiency 
means  for  these  comparisons  were  2.15  for  print  versus  1.21  for  CBI. 

Attitude  Results 

Given  that  each  attitude  item  dealt  with  a  different  property  of 
the  lesson,  analyses  were  conducted  to  examine  separate  outcomes  on 
each.    No  effects  were  obtained  on  Itons  2  ("interesting") ,  3  ("easy 
to  learn") ,  or  5  ("readable  layout") .    On  Item  1  ("lesson  moved 
quickly") ,  the  presentation  mode  x  density  level  interaction  was 
significant,  F  (1,  42)  =  5.15,  £  <  .05;  and  the  presentation  mode  main 
effect  approached  significance  (  £  <  .10).    In  follow-up  analyses^ 
using  the  Tukey  HSD  procedure,  the  only  difference  was  found  within 
the  high-density  condition:  print  subjects  (  M  =  4.25)  gave 
significantly  higher  ratings  (  £  <  .05)  than  CBI  subjects  (  M  -  2.50). 
On  Item  4^  ("amount  of  explanation  was  sufficient")  the  two-way 
interaction  was  again  significant,  F(2,  42)  =  4.22,  £  <  .05. 
Comparisons  between  presentation  modes  showed  significant  variation 
only  within  the  low-density  condition:  CBI  subjects  (  M  =  4.50)  rated 
t'ne  materials  higher  (  £  <  .05)  in  sufficiency  than  di3r  print  subjects 
(  M  =  3.23).    The  only  other  significant  finding  was  the  presentation 
mode  main  effect  on  item  6  ("prefer  method  over  lecture"),  F(l,  42)  = 
5.28,  £  <  .05.    CBI 'subjects  (  M  =  3.75)  were  more  positive  about  the 
teaching  method  received  than  were  print  subjects  (  M  =  2.96). 
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Discussion 


In  contrast  to  Reder  and  Anderson* s  (1980;  1982)  subjects  who 
were  tested  exclusively  on  factual  recognition  (via  treefalse 
questions) ,  the  present  sample  viis  administered  a  variety  of 
achievement  measures  designed  i:o  assess  factual  knowledge,  problem 
solving,  and  transfer.    The  absence  of  any  evidence  favoring  the 
high-density  text  is  consistent  with  the  view,  as  theorized  in 
hierarchical  models  of  text  structure  (Meyer,  1975),  that  retrieval  of 
ma^n  ideas  is  not  necesszrily  facilitateo  by  providing  additional 
deti^ils  (or  elaborations)  in  the  text.    HovA^ver,  if  students  are  to 
develop  good  reading  and  writing  skills,  frequent  exposure  to 
elaborated  and  structurally  sophisticated  text  styles  seems  essential. 
With  this  qualification  in  mind,  instructional  designers  might 
consider  selective  uses  of  low-density  narrative  to  reduce  lesson 
length  and  completion  time,  in  situations  (such  as  CBI)  vAiere  it  is 
costly  or  difficult  to  display  long  segments  of  text. 

Overall,  the  experimental  findings  were  not  supportive  of  OBI 
relative  to  print  as  a  delivery  medium  for  the  present  statistics 
lesson.    In  attempting  to  interpret  this  result  one  might  consider 
Clark's  (1983)  suggestion  that  it  is  not  media  per  se  that  affect 
learning,  but  the  instructional  strategj^es  that  the  given  medii  anploy 
(also  see  Clark,  1984;  i98S?  Solomon  &  Gardner,  1985).    Clark  (1983) 
reinforces  this  point  through  the  analogy  that,  "media  are  mere 
vehicles  that  deliver  instruction  but  do  not  influence  student 
achievement  any  more  than  the  truck  that  delivers  our  groceries  causes 
changes  in  our  nutL'ition"  (p.  45) .    From,  this  perspective,  the 
consistency  of  outcomes  across  media  stiidies  would  seem  more  validly 
"interpf^»:6d"^on  the  basis  of  the  instructional  strategies  used  and  the 
content  taught  rather  than  on  how  the  lesson  was  delivered.    It  thus 
becomes  important  to  recognize  the  present  lesson* s  dependency  on 
mostly  narrative  descriptions  of  rules  and  operations  and  allowance  of 
self-pacing.    These  instructional  features  remained  constant 
regardless  of  mode,  but  print  offered  the  possible  advantage  of 
representing  the  text  in  a  more  readable  and  accessible  form. 
Further,  most  subjects  in  the  pi^esent  study  were  unfamiliar  with  and 
probably  somewhat  threatened  by  both  the  statistical  subject  matter 
and  learning  from  CBI'.    Given  the  newness  of  CBI  for  the  present 
sample  and  its  reputation  as  a  "smart*'  medium^  (see  Clark,  1984; 
Salomon  &  Gardner,  1986) ,  it  would  seem  likely  that  many  subjects 
would  naturally  perceive  it  as  more  difficult  or  challenging  than 
print.    Such  perceptions,  if  they  occurred,  would  be  consistent  with 
the  high  degree  of  task  persistence  demonstrated  by  CBI  subjects  in 
their  very  deliberate  pacing  rates  and  preferences  for  high-density 
over  low-density  material  under  learner  control. 

Attitude  results  also  suggested  differences  in  how  the  two  media 
were   perceived.    Subjects'  generally  favorable  reactions  to  CBI  were 
conveyed  in  their  giving  it  higher  ratings  than  print  as  a  desired 
alternative  to  lecture.  Interestingly,  neither  mode  was  favored  on 
"clarity"  or  "readability"  dimensions,  iDUt  CBI  subjects  rated  the 
lesson  as  slower  moving  than  did  print  subjects,  especially  v^en  high 
density  material  was  used.   CBI  subjects  also  rated  low-density 
material  higher  in  sufficiency  than  did  print  subjects,  even  though 
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both  groups  received  the  exact  same  content.    Despite  these 
perceptions,  learner-control  selections  by  the  CBI  group  favored  high 
density  naterials  75%  of  the  time,  cocrpared  to  oly  a  25%  selection 
rate  imder  print*    The  overall  irrpression  is  of  a  less  confident  and 
more  conservative  attitude  of  the  CBI  group,  which  generally  worked  as 
a  disadvantage  for  achievement  and  learning  efficiency. 

Seemingly,  with  students  uore  experienced  with  CBI,  little 
difference  would  have  occurred  between  media.    Furuher,  potential  bias 
was  introduced  by  the  decision  to  design  realistic  rather  than 
parallel  CBI  and  print  displays  to  increase  the  external  validity  of 
density  cociparisons  within  each  medium.    In  both  applications  use  of 
iow-density  text  was  supported  fis  a  design  strategy  for  expository 
lessons.    The  spatial  limitations  of  electronic  displays  obviously 
makes  low-density  formats  especially  appealing  for  CBI. 
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Table  1 

Treatment  Means  and  Standard  Deviatiions  on  Major  Dependent  Measures 


■ 

Ma  A  ^1  IMA 

Print 

Computer 

ii*uensi  zy 

L*tontroi 

A1  1 

Al  1 

L-Dens1ty 

H-Dens1ty 

L-Controi 

All 

Knowledge-1  (17)^ 

M 

n 

13.1 

13.6 

13.1 

12.1 

11.0 

11.6 

11.6 

so 

1.8 

1.5 

2.0 

1.8 

3.4 

3.0 

2.8 

3.0 

Know1edge-2  (4) 

II 

n 

7.4 

7.3 

.9.0 

7.9 

8.1 

7.1 

7.5 

7.6 

so 

2.7 

4.5 

2.9 

3.4 

3.2 

3.3 

3.2 

3.1 

Calculation  (5) 

n 

3.8 

3.  8 

4.5 

4.0 

3.6 

2.4 

3.3 

3.1 

SO 

0.9 

1.5 

0.8 

1.1 

1.5 

1.7 

1.3 

1.5 

Transfer  (20) 

14.3 

M 

10.6 

10.9 

11.9 

10.5 

9.1 

.9.8 

9.8 

SO 

5.7 

4.3 

3.9 

4.8 

6.4 

7.3 

5.1 

6.1 

Attitude  Total  (30) 

• 

M 

20.0 

21.7 

21.5 

21.1 

21.6 

20.6 

21.9 

21.4 

SO 

4.9 

4.3 

3.0 

4.0 

2.9 

2.8 

2.7 

2.8 

Study  Time  (Min.) 

A 

17.4 

18.4 

18.4 

18.0 

24.3 

37.3 

35.5 

32.3 

SO 

3.7 

3.1 

3.8 

3.4 

8.4 

16.4 

13.1 

13.8 

^Numbers  In  parentheses  following  measures  Indicate  maximum  scores. 
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Figure  Caption 

Figure  !♦    Sample  low-density  and  high-density  frames  from  CBI  lesson. 
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Low-density  sample 


CENTRAL  TENDENCY 

A  summary  of  group  achievement  is  the  score  most  typical  or 
representative  of  all  scores  in  a 
frequency  distribution 

These  scores  are  measures  of  central  tendency 

Three  common  central  tendency  measures: 
Mode-most  frequently  occurring 
Median-middle  score 
Mean-the  "average" 

B<        Press  any  key  to  continue  >F 


High-density  sample 

CENTRAL TENDENCY 


A  good  way  to  precisely  summarize  group  achievement 
would  be  to  determine  the  score  ihat  is  most  typical  or 
representative  of  ail  scores  in  a  frequency  distribution. 
We  call  these  typical  or  representative  scores  measures  of 
central  tendency. 

A  measure  of  central  tendency  is  a  score  that  is  typical 
or  representative  of  a  group  of  scores.  Three  of  the  most 
commonly  employed  central  tendency  measures  are  the  mode 
(most  frequently  occurring  score),  the  median  (the  middle 
score),  and  the  mean  (the  "average"  score).  Most 
importantly  though-any  measure  of  central  tendency  is 
supposed  to  indicate  a  "representative"  score  value  for  the 
group  being  evaluated. 

B<        Press  any  key  io  continue  >F 
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A  Comparison  of  Instructional  Intervention 
Strategies  with  Newly  Amplified  Hearing-Impaired  Adults 

Introduction 

Aural  rehabilitation  is  an  area  of  audiology  that  has  received 
the  least  attention  and  research  (Alpiner,  1982a).    There  have  been 
major  improvements  in  the  technological  aspects  of  audiology,  but 
the  remediation  process  has  remained  virtually  unchanged  for 
decades.    There  have  been  efforts  to  identify  effective  and  efficient 
means  of  improving  benefit  from  hearing  aids  (Walden,  Prosek, 
Montgomery,  Scherr,  and  Jones,  1977;  Walden,  Erdman,  Montogmery, 
Schwartz,  and  Prosek,  1981;  Alpiner,  1982a).    None,  however,  have 
identified  an  approach  that  seems  to  be  consistently  effective. 

The  lack  of  advancements  in  the  rehabilitation  of  the  hearing- 
impaired  adult  is  of  serious  consequence.    As  the  population  ages, 
more  adults  are  being  diagnosed  and  fitted  with  hearing  aids,  but 
significant  numbers  become  frustrated  and  stop  wearing  their 
hearing  aids  during  the  first  few  weeks  (Alpiner,  1982a).  These 
individuals  need  to  be  offered  opportunities  to  adjust  to  and  function 
with  their  new  hearing  aid  easily  and  efficiently. 

In  many  of  the  studies  of  amplification  adjustment,  individual 
differences  were  often  ci^-^d  as  the  reasons  why  any  one  particular 
training  technique  or  combination  of  techniq-js  were  ineffective  in 
decreasing  the  perception  of  hearing  handicap  by  adults  (Bode  & 
Oyer,  1970;  Walden  et  al.,  1981).   The  perception  of  hearing  handicap 
can  best  be  defined  as  the  hearing-impaired  person's  feelings  about 
how  well  or  poorly  he/she  functions  in  listening  situations. 

It  may  be  that  the  differences  among  hearing-impaired  adults 
can  be  explained  by  differences  in  their  learning  styles,  Cronbach 
and  Snow  (1977)  have  suggested  that  the  manner  in  which 
individuals  approach  information  processing  situations  generally 
takes  the  form  of  nattems  established  early  in  life.    These  patterns 
or  strategies  are  termed  cognitive  style,  which  may  be  important  to 
consider  when  determining  their  individual  learning  styles  (Garger  & 
Guild,  1984).    Research  is  generally  in  agreement  that  the  more 
personalized  the  instruction,  the  faster  and  better  the  possibility  of 
accomplishment  of  a  given  task  by  the  individual  (Murray,  1979; 
Fourier,  1984). 

One  approach  to  personalizing  instruction  and  helping  the 
individual  understand  the  manner  in  which  information  is  processed 
is  termed  cognitive  style  disclosure.    Evidence  in  the  literature 
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suggests  that  this  approach  is  very  effective  in  community  college 
settings  (ffiU  &  Nunney,  1971;  Fourier,  1984;  Niles  &  Mustachio, 
1978).    It  is  possible  that  the  cognitive  style  disclosure  approach 
might  be  beneficial  in  the  aural  rehabilitation  of  newly  amplified 
hearing-impaired  adults. 

Summary  of  Research  Project 

The  purpose  of  this  study  as  to  identify  aural  rehabilitation 
training  strategies  that  would  significantly  reduce  the  feeling  of 
hearing  handicap  by  first-time  hearing  aid  users.    An  aural 
rehabilitation  program  was  used  composed  of  a  brief  introduction  to 
hearing  aids  and  the  skills  associated  with  using  a  hearing  aid 
(Traynor  &  Smaldino,  1986)  (Appendix  A).   This  approach  to  aural 
rehabilitation,  alone  or  in  coiiibination  with  information  about 
cognitive  learning  style,  as  presented  to  first-time  users  of  hearing 
aids.   Cognitive  style  information  was  also  presented  to  a  group  of 
new  hearing  aid  users  without  including  any  additional  components 
of  the  aural  rehabilitation  program. 

The  study  involved  assessing  listening  performance  in 
situations  both  before  and  one  month  following  the  wearing  of  the 
new  hearing  aid.    The  prefitting  inventory  was  used  to  measure  the 
client's  perception  of  hearing  handicap.    Also  included  was  an 
assessment  of  individual  cognitive  learning  styles. 

A  further  question  investigated  in  this  study  was  to  determine 
if  there  was  a  correlation  between  the  subscales  of  the  cognitive 
learning  style  inventory  and  the  subscales  of  the  hearing  handicap 
inventory.    This  was  a  preliminary  effort  to  sec  if  there  was  any 
relationship  between  the  presence  or  absence  of  a  particular 
cognitive  learning  style  and  elements  of  a  hearing  handicap. 

Forty  newly  amplified  hearing-impaired  adults  ranging  in  age 
from  30  to  90  served  as  subjects  in  this  study.   They  had  not  worn  a 
hearing  aid  prior  to  participating  in  this  study.    Each  participant 
completed  the  revised  Albany  Learning  Style  Inventory  (Bosco, 
1983)  and  the  revised  Hearing  Performance  Inventory  (Lamb, 
Owens,  Schubert,  and  Giolas,  1979)  prior  to  their  random  assignment 
to  a  treatment  group.   There  were  four  groups:  Control  (CG),  Cognitive 
Style  Disclosure  (CSG),  Aural  Rehabilitation  (ARG),  and  Cognitive  Style 
Disclosure/Aural  Rehabilitation  (CS/ARG).    Each  subject  received  one 
of  these  treatments  during  a  four-week  trial  period.    At  the  end  of 
the  four-week  trial,  each  participant  completed  the  Hearing 
Performance  Inventory  again. 
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The  statistical  procedure  used  for  data  analysr»  v/a^  a  two-way 
analysis  of  variance.    A  correlation  matrix  was  devLlopcd  to 
investigate  the  relationships  between  the  subscales  of  the  two 
inventories. 

Conclusions  of  the  Study 
Perception  of  HcL-.ug  Handicap 

The  first  three  experimental  questions  were  designed  to 
identify  possible  altematwe  training  procedures  in  the  rehabilitation 
of  newly  amplified  hearing,  impaired  adults.    The  dmerencc  between 
the  pretest  and  posttest  score  of  the  Hearing  Performance  Inventory 
were  used  to  calculate  means  for  the  four  groups  studied  (Table  1). 
The  result  of  the  two-way  ANOVA  suggested  that  the  participation  in 
aural  rehabilitation  did  affect  the  perception  of  hearing  handicap  by 
hearing-impaired  adults  (Table  2). 

This  indicated  that  those  subjects  who  had  received  aural 
rehabilitation  experienced  a  greater  reduction  in  their  perception  of 
their  handicap  than  those  who  had  not  received  the  aural 
rehabilitation  intervention.    The  information  provided  in  the 
cognitive  style  disclosure  component  of  the  intervention  procedures 
did  not  seem  to  have  a  signinc4nt  effect  on  the  change  scores. 

Correlation  of  Subscales 

The  difference  scores  between  the  pretest  and  posttest  scores 
on  the  Hearing  Performance  Inventory  were  used  to  correlate  with 
each  of  the  four  subscale  category  scores  from  the  Albany  Learning 
Style  In/entory,  thr.  instrument  used  to  measure  characteristics  of 
learning  style.  The  four  characteristics  of  cognitive  style  measured 
by  this  instrument  were  magnitude,  difference,  relationship,  and 
deduction. 

A  Pearson  product-moment  correlation  statistic  was  used  to 
measure  the  relationship  between  the  variables  (Table  3).  The 
correlations  obtained  a  positive  trend  in  the  relationship.    There  does 
not  appear,  however,  to  be  enough  strength  within  any  of  the 
co)r''      -s  *?  imply  a  signiHcant  relationship  between,  any  of  thfc 
id-  tiacteristics  of  cognitive  style  and  the  ide.itified 

c  jf  perception  of  hearing  handicap. 
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Aural  Rehabilitation 


The  results  of  this  study  strongly  indicate  that  newly  amplified 
individuals  can  benefit  from  participation  in  a  short-term  aural 
rehabilitation  program.    Those  individuals  who  received  the  aural 
rehabilitation  intervention  techi.ique  indicated  a  significantly  greater 
reduction  in  their  perception  of  their  hearing  handicap  on  the  post- 
treatment  inventory. 

This  conclusion  supports  the  position  taken  by  those  specialists 
within  the  field  of  audiology  that  newly  amplified  hearing-impaired 
adults  should  be  provided  with  more  than  mere  instruction  in  the 
operation  of  their  new  hearing  aids  (Alpiner,  1982a;  Sanders,  1982; 
Giolas,  1982;  Davis  &  Hardick,  1982),   The  kind  of  program  suggested 
by  these  authorities  focuses  on  several  aspects  of  adjustment  to 
amplification.    Emphasizing  skills  related  to  the  communication 
process  can  benefit  the  new  hearing  aid  user.    The  preliminary 
impression  from  the  statistical  analysis  of  the  data  in  this  study 
indicate  that  participation  in  a  program  that  teaches  communication 
skills  can  reduce  self-reported  hearing  handicap. 

Cognitive  Stvle  Disclosure 

Another  finding  from  this  study  was  that  informing  adults 
about  their  particular  cognitive  style  did  not  seem  to  have  any 
influence  on  their  reported  success  with  amplification.    Telling  the 
participants  of  the  manner  in  vhioh  they  process  information  did  not 
influence  any  change  in  their  perception  of  their  hearing  handicap. 
It  seems  that  while  cognitive  style  disclosure  has  been  shown  to  be 
an  effective  approach  in  academic  situations  (Fourier,  1984;  Hill  & 
Nunney,  1971;  Niles  &  Mustachio,  1978),  it  did  not  appear  to  apply  to 
this  particular  non-academic  situation. 

The  literature  related  to  cognitive  style  disclosure  involved 
academic  settings,  principally  the  community  college  (Fourier,  1984; 
Hill  &  Nunney,  1971;  Niles  &  Mustachio,  1978).   In  those  settings,  the 
students  were  very  aware  of  specific  expectations  required  of  them. 
It  is  possible  that  the  nature  of  cognitive  style  disclosure  is  such  that 
it  is  not  applicable  to  other  kinds  of  instructional  situations  where 
the  expectations  of  the  learners  are  less  clear.    It  is  also  possible  that 
the  nature  of  cognitive  style  disclosure  is  applicable  to  these  other 
kinds  of  instructional  situations,  but  that  modifications  in  the 
approach  need  to  be  made. 
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Table  1 


Summary  Table  of  the  Means  and  Standard  Deviations  of 
the  Difference  Scores  of  the  Four  Groups  on  the 
Bearing  Performance  Inventory 


Group 

Mean 

Standard  Deviation 

Control 

30.20 

72.13 

Cognitive  Style 
Disclosure  Only 

41.40 

57.44 

Aural  Rehabili- 
tation Only 

104.90 

59.60 

Aural  Rehabili- 
tat  ion/Cognit  ive 
Style  Disclosure 

100.00 

43.69 

Table  2 

Summary  Table  for  the  Two-Way  ANOVA 


Row  Variable  =  Cognitive  Style 

Column  Variable  =  Aural  Rehabilitation 


Row  Variable;  ss=99.225  DF=  1  MS=99.225  F=  .047 
Column  Variable;  ss=444.22.225    DF=  1  MS=44422.225 

F=20.999* 

Interaction;    ss=648.025    DF=  1    MS=648.025    F=  .306 
Error-W;      ss=  76156.9      DF=36  MS=2115.469 
Total;  ss=121326.375      DF=  39 


*  £  >.05. 
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Table  3 


Summary  Table  for  the  Correlation  Matrix 


Albany  Learning 
Style  Instrument 
Subscales 


Hearing  Performance 
inventory  Subscales 


o  «  ta  e 

e  "O  c  o 

0  g  O 

14  4i  -H  *> 

4M  6  «  9 

<U  Ot  (-4  'O 

!S  S  «!  « 

O  S  M  O 


Understanding  Speech 
with  Visual  Cues 


.184       .381      .434  .296 


Understanding  Speech 
without  Visual  Cues 


.481       .093      .186  .113 


Intensity 


.301       .285      .334  .116 


Response  to 
Auditory  Failure 


.374       .185       .200  .089 


Personal 


.202      .365      .090  .379 


Social 


.423      .152      .235  .175 
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Computerized    Adult  Aural  Rehabilitation  Program 
J*  Smaldino  and  R*  Traynor 
Little,  Brown  and  Company 
1986 


Session  1  —  The  Auditory  System  and  How  It  Works* 

Goals:  To  aguaint  the  client  with  the  auditory 
mechanism,  how  it  operates  and  specific 
disorders  that  can  cause  hearing  losses 
operates. 

To  inform  the  client  about  the  operation 
of  and  the  difficulties  encountered 
utilizing  a  hearing  aid*    Further  to 
aguaint  the  client  with  assistive  devices 
that  may  be  beneficial* 

Objectives: 

1*  Present  and  make  sure  each  client  under- 
stands anatomy  of  the  ear* 

2*  Present  and  make  sure  each  client  under- 
stands the  physiology  of  the  ear* 

3*  Determine  specific  diagnosis  for  each 
client  and  explain  the  pathology  in 
detail* 

4*  Describe  the  modifications  often  conducted 
on  the  hearing  instruments  to  facilitate 
better  communication* 

5*  Determine  the  situations  in  which  the 
clients  may  have  difficulty* 

Session  2  —  Auditory  Training  . 

Goals:  To  simulate  various  types  of  progressively 
worse  listening  situations  and  teach  the 
client  coping  strategies* 

Objectives: 

1*  Listen  and  repeat  word  stimuli  correctly 

when  noise  is  progressively  introduced  in 

the  background* 
2*  Listen  and  repeat  phrase  stimuli  correctly 

when  noise  is  progressively  introduced  in 

the  background* 
3*  Listen  and  repeat  sentence  stimuli 

correctly  when  noise  is  progressively 

introduced  in  the  background* 
4»  Listen  to  stories,  in  guiet  and  in  noise, 

and  correctly  answer  guestions  related  to 

each* 
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Session  3  —  Speechreadlng 

Goals:  To  utilize  visual  cues  to  augment 
communicat  ion  * 

Objectives:  ^     ^    ^.  ^ 

1.  Present  and  insure  an  understanding  of 
basic  rules  for  speechreadingr  i.e. 
keep  hands  away  from  mouth,  etc. 

2.  Present  and  insure  understanding  of 
tips  for  effective  communication. 

3.  Describe  the  structure  of  language. 

4«  Describe  the  predictability  of  language. 

5.  Demonstrate  how  the  most  obvious  speech 
sounds  look  o?.i  the  face. 

6.  Give  assignment  to  turn  down  T.V.  and 
watch  a  newscaster's  face  to  determine 
the  message  presented* 

7.  Present  specific  lessons  where  client 
client  needs  to  watch  for  specific  lip 
movements. 

8.  Describe  and  practice  homophenous 
words. 

9.  Describe  and  practice  sentences  that 
can  be  predicted  by  certain  lip  move- 
ments and  structure  of  language. 

10.  Describe  and  practice  sentences  that 
can  be  predicted  by  context  and 
situational  cues. 

Session  4  —  Environmental  Situations 

Goals:  To  utilize  the  auditory  and  visual  skills 
obtained  in  the  previous  sessions  to 
communicate  in  a  realistic  situation* 


Objectives:  ^  ^ 

1.  Simulate  numerous  situations  and  conduct 
role  play  with  the  client  in  quiet. 

2.  Simulate  numerous  situations  and  conduct 
role  play  with  the  client  in  noise. 

3.  Instruct  the  client  on  the  use  of  the 
telephone  with  the  hearing  aid  if  the 
client  is  having  difficulty  in  that 
situation. 

4.  Assist  the  client  in  developing  some 
strategies  for  coping  with  meeting 
new  people. 

5.  Assist  the  client  in  developing  some 
strategies  for  coping  with  large  group 
situations. 

6.  Assist  the  client  in  developing  some 
strategies  for  coping  with  difficult 
communication  situations. 
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OOGimTE  PSTCHOLOCT:    nPLICATIOIS  lOB  SELECTIOI  OF  tKCHIIQlIES  AID 

BEASDSES  TM  USTBVCTXOIAL  BESEAKCE 


Bruniag  (1963),  SBOog  mof  others,  reports  a  clear  metatheoretical  shift  in 
the  field  of  instructional  design  and  tecfanologr  f roi  a  hehaTioristic 
fzaaevork  to  a  cognitiTe  f rameworlc. 

Gagne  and  Ihite  (i978}  describe  the  cognitiTe  theories  th&t  haTe  contrihuted 
to  this  fraaevork: 

These  theories  support  the  bdsic  notion  that  the  effects  of  instruction 
mj  best  he  understood  hy  exploring  the  three-ten  relation  Instruction- 
Uemorr  Structure-Learning  Outcoie.   In  other  vords,  the  suggestion  is  aade 
that  the  effects  of  instruction  mj  he  explained  hj  taking  into  account 
the  processing  of  various  f ons  of  instruction  br  the  learner,  thP  first 
results  of  vhich  are  the  acquisition  of  particular  kinds  of  nev  menorr 
structures.   The  latter  structures,  in  turn,  are  antecedents  that  enable 
the  huaan  learner  to  display  retention  and  transfer  in  tens  of  nev 
perforaances  (p.  187). 

Ohis  cognitive  perspective  is  further  described  hf  fittrock  (1979): 

A  cognitive  approach  iaplies  that  learning  f  roa  instruction  is 
sclent  if  icallT  acre  productively  studied  as  an  interully,  cognitively 
mediated  process  than  as  a  direct  product  of  the  environaent,  people,  or 
factors  external  to  the  learner.  The  approach  involves  understanding 
relations  or  interactions  betveen  the  learners'  cognitive  processes  and 
aptitudes,  such  as  attribution,  aotivation',  encoding,  aeaory,  cognitive 
styles  and  cognitive  structures,  and  the  characteristics  of  instructional 
treatments  (p.  5). 

The  predominant  theories  that  are  identified  vith  cognitive  psychology  as  it 
relates  to  instruction  are  gestalt  theory,  information  processing  theory,  and 
schema  theory.    These  theories  postulate  the  effects  of  instruction  on  mental 
structures  and  processes  and  the  effects  of  the  structures  and  processes  on 
learning  outcomes.  Uany  researchers  in  instructional  technology,  particularly 
those  vho  aspire  to  contribute  to  instructional  theory,  develop  their 
theoretical  framevorks  from  one  or  more  of  these  categories  of  theory. 

Although  cognitive  psychology  may  have  an  impact  upon  the  theory  bases  from 
vhich  ve  drav  our  conceptual  framevorks,  it  appears  to  have  had  very  little 
impact  upon  the  dependent  measures  and  the  data-collection  techniques  that  ve 
use  in  eigpirical  studies  in  our  field.     Post  test  scores  seem  to  the  primary 
data  source  in  the  majority  of  our  studies,  leading  some  critics  of  research 
in  our  field  to  liken  our  studies  to  "horse  races  that  only  loctk  at  vho 
(^ch  treatment)  gets  to  the  post  first. ' 

Cognitive  psychology  literature  has  provided  us  vith  data  collection 
techniques  and  dependent  measures  that  allov  us  to  examine  the  influence  of 
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tDStruetiOMl  nnlpulatlofis  m  ec^tlTS  processes  aal  stiuetures.  IdentlfTiog 
tfftctitt  (•ad,  pertatps,  tfficitnt  •nd  •Lppealiag}  iastructiooal  treataents, 
vtiich  coablMtloDS  of  ibiob  InsttuctloDBil  variables  for  itlch  learners  unAer 
ibich  circuastaacaa  contributes  to  utiich  learning  outcoaes,  an?  be  the 
ultiiate  goal  of  luch  of  our  tesearcb.  BOwerer.  failure  to  consider  tbe 
aediatiag  aecbnaisas  of  cognitive  processes  and  structures  using  these 
cognitive  psjebology  techniques  and  measures  is  uof  ortunate  because  it 
deprives  las  oi  a)  sensitive  aeatures  that  nay  find  si^tle^  but  potentially 
potent,  differences  In  instruction  treataents;  b)  data  that  allov  us  to 
describe  more  coipletelr  vbat  has  happened  to  learners  as  a  result  of 
instruction;  c)  inf onation  that  can  help  us  to  explain  «far  ve  find 
differences  in  students*  perfonances  after  different  instructional 
treatments;  and  d)  insight  into  additiooal  triestions  that  ve  may  vish  to 
inrestigate.    In  ^rt,  the  omission  limits  our  ability  to  refine,  revise,  or 
extend  instructional  theory. 

The  purposes  of  this  paper  are  to  a)  describe  data-gathering  techniques  and 
consequent  dependent  measures  that  are  little  used  but  have  much  potential  in 
our  field  and  b)  validate  empirically  that  these  options  are  seldom  used  in 
instructional  design  and  tedmology  studies. 


Ihis  section  vill  describe  the  f olloving  four  categories  of  data-gathering 
techniques  and  their  consequent  dependent  measures: 

a)  secondary  task  techniques,  b)  eye-movement  records,  c)  verbal  reports,  and 
d)  representations  of  co^tives  structures.    Each  technique  and  measure  vill 
be  discussed  in  terms  of  processes  or  structures  vhidi  they  are  faypcthesited 
to  indicate  and  advantages  and  disadvantages  of  each. 

SacoBdary  rmtHz  TachBiqmsa 

Ihstructional  researchers  that  vat  secondary  task  techniques  ask  the  subject 
to  complete  a  primary  task,  the  learning  task  (such  as  responding  t9 
Instructional  materials),  and  at  the  same  time  give  some  attention  to  a  less 
important,  secondary,  taSk.   Generally,  the  variable  of  interest  to  the 
researcher  is  the  latency,  the  speed  of  performance  of  the  secondary  task. 
BOst  often,  this  type  of  technique  and  measure  is  used  vithin  a  limited 
capacity  model  of  working  memory.  Tbe  model  postulates  that  the  longer  it 
takes  the  subject  to  respond  to  the  secondary  task,  the  greater  the  amount  of 
working  memory  is  dedicated  to  the  primary,  learning,  task.   Special  equipment 
is  gennrally  required  to  use  this  type  of  measure,  as  cognitive  operations  may 
occur  very  fast,  i  -  250  milliseconds  (Gagne,  1985). 

Britton,  Piha,  Davis,  and  fehausen's  study  (1976)  is  example  of  the  utility  of 
this  technique.  Previous  research  bad  established  that  inserted  questions  in 
textual  materials  improved,  coiprehension.  Britton  et  al.  questioned  Hif  this 
occurs.  In  their  study,  one-half  of  the  subjects  received  inserted  questions, 
the  other  half  received  text  only.  During  the  reading  task,  the  subjects  vere 
given  a  secondary  task  of  responding  to  audible  clicks  by  releasing  a  button. 
As  the  researchers  predicted,  the  students  in  the  inserted  q^estions  group  had 
longer  response  latencies  than  the  text-only  group  and,  as  vith  past  research. 


f  otamtiml  TachBiqaem  and  Semsorms 
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tbeir  coipr«heD8lon  i»s  greater.  Britton  et  al.  interpreted  tMs  result  to 
ifldioite  ttaiit  coaprefaention  «a»  greater  fcr.thoee  tiibjecte  that  received 
inserted  questions  because  Um  questions  caused  tbe  learners  to  inrest  greater 
cognitiTt  capacity  (e.g. ,  to  try  barder)  in  the  learning  task. 

Lerin,  Dretzke,  UtoComidc,  Scruggs*  BOGiTen,  and  Bastropieri  (i933>  collected 
latency  data  for  a  different  purpose.   In  their  studies  isrestigating  the 
effects  of  using  a  UMnonic  picture  strategy  on  learning  the  ordtr  of  the  U.  S. 
presidents,  one-half  of  the  learners  vere  taught  a  menonic  strategy  for 
reneabering  Terbal  inf oraation,  the  reaaining  half  of  the  leametj,  the 
control  group,  vere  allowed  to  use  any  strategy  they  wished.  During  the 
recall  test,  the  researchers  tined  the  delay  between  the  presentation  of  the 
question  (e.g.,  "which  nuiber  was  Lincoln?"}  and  the  r*^ject's  response.  They 
found  that  the  response  latency  for  subjects  in  the  ex)>»riBental  group  was 
significantly  longer  than  for  those  in  the  control  group.  The  inrestigators 
concluded  that  this  diff  rence  was  due  to  the  'coiplex  retrieval  denands*  of 
the  menonic  strategy,  an  eridence  of  the  stvlbjects*  using  the  strategy. 

Ik  najor  disadvantage  of  such  approach  is  the  difficulty  in  acquiring  the 
viquipnent  to  record  and  analyse  reponse  tines.   In  addition,  there  hare  been 
ftone  criticisas  of  the  inferences  that  can  be  Mde  based  upon  such  data.  For 
esaaple,  learners  seen  to  be  able  to  learn  to  acconaodate  the  secondary  task 
with  practice  until  response  becones  alaost  autonatic,  regardless  of  the  depth 
of  processing  required  by  the  priaary  task  (see  FiSk,  Derrick,  6  Schneider, 
1962;  Jacobs,  Deipsey,  &  Salisbury,  1987}  (See  Britton,  Seyer,  Hodge,  and 
Glynn  (1980},  Fehniraim  (1973},  and  Kerr  (1973)  for  additional  inforaation  on 
this  technique. } 

Eyt-norenent  lecords 

Fye-norenent  records  provide  researchers  Inf omation  ebout  where  and  for  bow 
long  a  subject  fixes  his  or  her  gaae  upon  •  giren  display.   Such  data  gives 
researchers  data  regarding  where  a  subjects'  attention  is  focused  a  given 
point  in  tine  and  sequentially  how  this  attention  is  changed  over  tine.  Eye 
fixations  (periods  of  tine  when  eyes  cease  notion)  nay  also  give  inrestigators 
sons  indication  of  the  points  at  which  learners  pause  to  reflect,  providing 
inf  onation  of  how  learners  "chunk"  inf  onation.  Eye  norenents,  such  as  "look 
forwards*  and  "look  backs, "  lay  provide  inf  onation  as  to  points  at  which 
confusions  arise.  (For  nore  infonation  on  interpreting  eye  novenent  data,  see 
Farshan-Biggery  6  Gregg,  1975;  Just  6  Carpenter,  1980;  Snow,  1968. }  Often,  the 
processix^  that  nay  be  inferred  by  such  novenents  is  so  autonatic  that  it  is 
unavailable  to  other  f  oibs  of  observation  and  is  not  recollectable,  and, 
therefore,  unavailable  to  subjects  for  retrospective  recall  (see  later 
section  on  verbal  reports).  Eye  novenents  aay  be  the  only  r.ource  of 
infonation  about  sone  refined  aspects  of  processing. 

Eye  novenents  lay  be  classified  a  alcro  or  aacro  novenents  (Schunacher  ani 
laller,  1985).  Kicro-eye-novenents  are  fixations,  regressions,  and  novenents 
that  focus  on  individual  units  of  a  text  or  pictoilal  display.   Such  novenents 
are  recorded  by  recording  the  reflection  of  a  saall  anount  of  lig!xt,  usually 
Infrared,  off  the  cornea  of  tne  subject's  eyes.  The  reflection  of  the  light 
is  recorded  by  a  photoelectric  device  that  is  usually  interfaced  with  or  an 
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Integnl  part  of  •  coiputer.  Zqaipient  is  geDerally  fairly  eipenslTe  aM 
•opbiatioattd,  ra^iiriag  toM  kAovltdga  of  coaputor  prograaaiao  to  aat  tarioua 
paraBttart  of  tba  aquipMnt.  Alto,  tba  aguipaant  oftan  raqoiras  tbat  tbe 
aubjaet'a  hoad  aoraaenta  ba  raatricttd  in  aoaa  mj,  Ittitiag  tha  acological 
ftlidity  of  tha  attdy.  and,  tb»!:etora,  tba  generalisa^ility  of  tba 
conelaaioaa. 

Sum  atttliaa  invaatigatiag  tba  af facta  of  coaputtr  or  print  diaplays  aay  not 
raqulra  a  racord  of  tba  fine-grained  aorenents  provided  by  tbe  nicro-noyeaent 
agulpMat.   In  audi  eaaea*  invaatigatora  aay  viab  to  aeasura  aacro-aya- 
MvaMnta.  tttcro-eye-Boraaenta  are  grosser  eye  aoraaents  across  larger 
aagaaata  of  tbe  dim>lay«  audi  as  acroaa  paragraphs  and  pages  of  text. 
SftlWBMcber  and  filler  describe  three  types  of  procedures  tbat  are  suitable  for 
recording  aacro-aoraaaata.  lha  first  (Ibtlley  &  Flaaing*  1978}  records  tbe 
Boreaent  of  a  light-pen  ibicb  the  subject  aores  across  pages  of  text.  Ibis 
tedmiqoe  allows  tbe  Investigator  to  note  tbt  tine  tbat  tba  subject  spati^s  on 
each  sfsgaent  of  text,  look  hades,  and  look  fonards.  Tbe  secom  (Pugb.  1^79) 
videotapes  tao  iaiges.  eye  aoveaents  and  text  of  a  page,  tb^^ougb  tbe  use  of  a 
seai-silverc4  plate  of  glass.  Ibis  procedure  allows  tbe  investigator,  by 
vieviag  tbe  videotape,  tw  note  lookbadcs.  lookf  oraards.  note  taking,  and 
besitatiODS.  Tbe  third  procedure  (Bout  Welters.  1902}  involves  tbe  subject 
aoving  a  special  pen  across  a  text  page  aa  (s}be  reads.   It  does  not  directly 
record  tbe  eye  aoveaents  of  tbe  user,  in  advantage  of  this  equipaent  Is  that 
it  also  can  aeasure  reqioase  latency  and  galvanic  akin  responses.  (For  acre 
Inf  omation  ol  eye  aoveaent  recording  equipaent  see  Egan  t  Griaes-Farrov. 
1976;  (Pulf  and  Yestem  Sesearcb  bevelopaent  Groiy.  1978:  Kof  f .  liaan.  t  Yong. 
1971;  Touog  6  Sheens.  1975} 

Fleaiag  (1984}  used  eye  aoveaent  egulpnent  to  record  tbe  duration  of  attention 
to  vord  and  picture  eleaents  of  a  display  •at  to  record  tbe  patterns  of 
transitions  betveen  display  areas.  He  iss  investigating  tbe  effects  of  two 
variables:  level  of  coaplexity  of 

inf  omation  (siiple  vs  coaplex}  and  page  layout  (picture  first  vs  text  first}. 
Learner  variables  included  in  study  vere  gender,  cognitive  style  (f  ^.tld 
independence/field  dependence},  and  prior  knovledge.  Pependent  aeasures  were 
durations,  transitions,  and  sequences  of  aye  aoveaents.   Fleaing  found  that 
e  feaales*  durations  vere  longer  overall. 

•  all  subjects'  durations  vere  longer  for  coaplex  than  for  siaple  aaterial. 
e  there  was  an  interaction  betveen  cognitive  style  and  coaplexity  on  the 

BMber  of  transitions,  vith  field  independents  aaking  fever  transitions  on 
siaple  Mterlals  and  aore  transitions  for  coaplex  aaterials  then  did  f  ieU 
depeadents  (e.g. .  they  adjust  processing  according  to  coaplexity  of 
MtterialsV 

•  aal(   (as  coapared  to  feaales}  tended  to  aake  aore  reverse  transitions 
vhen  given  the  vords  first  layout  (they  tended  to  lode  at  the  pictures  first}. 

In  addition  to  the  expense  and  coaplexity  of  such  equipaent.  (here  are  three 
oth^r  potential  disadvantages  of  such  tedmiques.   First,  as  noted  earlier, 
aone  of  the  equipaent  requires  ttet  both  stiaulus  aaterials*  and  subjects'  be 
fixed  in  uaiatural  or  fixed  positions.   Such  a  requireaent  aay  liait  the 
generalixabllity  of  tbe  conclusions  of  studies  using  such  eqMlpaent.  Tbls 
disadvantage  seeas  to  be  aore  significant  for  the  nicro-eye-aoveaent 

5 


ERIC 


710 

698 


tedmlgues.   Seccod,  as  with  secoodarr  task  tedmiques,  researchers  lust  be 
cautious  in  the  ixkferences  regarding  processing  that  the?  neJce  in  response  to 
such  data  (Just  (■  Carpenter,  1980;  BcConkie,  BOgahoai,  folTerton,  Zola,  6 
Lucas,  1979).    Such  limitations  My  be  soievhat  obviated  by  collection  of 
coipleientarr  data,  such  as  Terbal  reports.  For  ezaiple,  Tldeotapes  resulting 
from  use  of  one  of  the  procedures  described  above  sight  be  used  to  stimulate 
retrospective  verbal  reports.  Third,  these  data  collection  techniq-ies  result 
in  aanr  data  points  that  nust  be  reduced  for  analysis.   Hovever,  the  more 
sophisticated  micro-movement  e(iuipment  often  include  reduction  and  analysis 
programs  that  produce  graphic  representation  and  other  analyses  of  movement 
data. 

Terbal  Seports 

Terbal  reports  are  subjects'  verbal  statements  that  are  made  before,  during, 
or  after  performing  a  learning  task  (Gagne,  1985).   Terbal  reports  can  be 
concurrent,  occurring  as  the  subject  completes  the  t&sk,  or  retrospective, 
occurring  after  the  subject  has  coapleted  the  learning  task.    Subjects  in 
studies  using  these  techniques  are  generally  asked  to  verbally  (gimerally, 
orally)  describe  ihat  they  plan  to  do  to  coiplete  the  taSk,  ihat  they  are 
thinking  about  as  they  complete  the  task,  or  ihat  they  did  as  they  coipleted 
the  task.   The  intermediate  stage,  describing  irtiat  is  thought  about  while 
coipleting  the  task,  is  often  called  a  "read-thlxft  aloud"  technlqius  (Flower 
and  Hayes,  1981). 

These  verbal  responses  are  typically  transcribed  into  vritten  form, 
protocols,  and  examined  for  patterns  of  responses,  protocol  aiimlysis 
(Ericsson  t,  Simon,  1984).  These  protocols  can  be  examined  for  such  processing 
features  as  generation  of  mental  elaborations  (additional  exa^>les, 
inferences,  co^Mirlson,  analalogles,  mnemonics),  paraphrases,  misconceptions 
and  their  rectification,  sunmarization/reviev/rehearsal,  organization,  self- 
monitoring,  rereading,  imaging,  and  questioning.   Seduction  of  the  voluminous 
data  that  results  from  such  a  techique  usually  invclves  some  qualitative 
research  techniques.  Using  this  data,  researchers  can  look  for  differences  in 
processing  patterns  ihich  may  be  due  to  manipulation  of  instructional 
variables. 

Levin,  bretzke,  UcCormlck,  Scruggs,  BcGlven,  and  Ifastropleri  (1983)  used 
verbal  report  data  in  their  study  investigating  the  effects  of  using  a 
mne&onic  picture  strategy  on  learning  the  order  of  the  U.  S.  presidents.  l:!ter 
they  co^)leted  the  learning  task,  subjects  were  aSked  about  the  strategies 
that  they  eiqtloyed  during  the  recall  task.   The  investigators  used  this 
technique  to  determine  the  degree  to  ihlch  those  instructed  on  the  mnemonic 
strategy  actually  used  it  and  irtiether  those  irtio  vere  not  instructed  on  the 
strategy  used  a  similar  strategy  (factors  ibich  might  have  confounded  their 
results). 

fedman  and  Smith  (1986)  are  using  a  read-thiidc  aloud  procedure  to  investigate 
the  processing  differences  between  subjects  iho  are  learning  the  relationships 
of  camera  variables  from  either  a  hierarchically  organized  strategy  or  an 
elaborated  strategy.  Thus  far,  the  data  has  led  them  to  tentatively  conclude 
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ttat  subjects  stuirliV  the  elaborated  Tersion  are  more  facile  In  solvlsg 
problems  that  in?olTe  the  aanipulation  of  two  or  more  variables. 

Am  vith  the  other  tecfaniquee^  verbal  reports  have  sc^ie  limitations, 
first «  the  amount  of  data  that  is  produced  using  such  techniques  is 
CQBSideraLble*  theref  ore*  reduction  of  the  data  is  eztremely  time-consuming  and 
tedious.  This  limitation  results  in  either  a)  using  probed  recalls  to  focus 
on  ODlr  particular  ejects  of  the  subjects'  processing  or  b)  limiting  the 
Buiber  of  subjects  used  in  a  study  of  this  nature. 

Second*  Terbal  reports  are  subject  to  some  of  the  same  problems  of  other  self- 
report  data:   Subjects  may  respond  in  a  manner  that  the  feel  the  researcher 
vlShes  to  respond.   In  addition*  subjects  can  discuss  only  that  vhich  is 
conscious  on  their  part.  Uuch  of  the  processing  that  they  engage  in  may  be  as 
hidden  to  the  subject  as  it  is  to  the  researcher.  This  may  lead  subjects  into 
making  inferences  about  their  own  processing  to  coi^lete  incoiplete 
recollections. 

Third*  and  probably  most  significant*  the  procedures  employed  make  more 
demands  on  the  limited  capacity  of  vorking  memory  than  the  leaoiing  task 
Itself*  leading  researchers  to  question  the  validity  of  both  the  processing 
information  and  the  task  performance  data.  This  is  especially  a  limitation 
vlth  concurrent  verbal  reports.   The  subjects*  attespts  to  report  their  om 
processing  may  subvert  their  performances  on  the  learning  ta^  vhich  may  in 
turn  invalidate  their  processing  techniques.  Ericsson  ar/l  Simon  (1980) 
describe  the  limitations  of  verbal  reports  and  the  conditions  under  vhich  such 
techniques  are  most  valid.   Some  of  their  suggestions  are  that  a)  in 
concurrent  reports*  subjects  should  be  asked  idiat  they  are  doing  rather  than 
liow  or  ilif  they  are  doing  something*  b)  that  retrospective  reports  follow 
immediately  after  the  taSk  and  are  cued  by  evidences  of  the  subjects  actions 
(such  as  video  tapes  of  the  subject  completing  the  learning  task}*  if 
possible*  and  c)  that  prObing  questions  are  very  specific  'Did  you  break  the 
task  Into  sUbgoals?  Ihich  subgoals  did  you  break  the  task  into"  rather  than 
general  "Did  you  use  a  prOblem-solving  technique?" 

BaprmmentmtioBS  of  Cognitivm  Stracture 

*SbB  previous  three  techniques  are  used  to  make  inferences  about  the  cognitive 
processes  that  subjects  engage  in  as  they  complete  a  particular  learning  task. 
THie  final  category  of  techniques  atteipt  to  acquire  a  physical  representation 
of  the  cognitive  structures  of  subjects.  Originally*  these  techniques  vere 
developed  in  order  to  colore  the  cognitive  structures  of  learners  vith  the 
content  structure  of  material  to  vhich  they  have  been  exposed  (Preece*  i976; 
Sbavelson*  i972}.   These  techniques  may  be  used*  hovever*  to  coi^Mire  the 
mental  representations  of  content  that  are  developed  as  a  result  of  studying 
tvo  or  more  versions  of  instruction.    In  other  vords*  they  may  be  used  to 
examine  the  effects  of  instructional  variables  on  cognitive  structure. 

The  data  that  is  obtained  from  these  techniques  are  indices  of  the  semsintic 
proximity  or  semantic  distance  betveen  pairs  of  vords.    Several  procedures 
that  are  used  to  gather  this  information  are 
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•  loid  association  tests 

•  construction  of  linear  graphs  (trees) 

•  siiilaritr  ratings 

•  free  recall  (with  an  exeBination  of  extent  to  ibich 
particular  vords  are  clustered) 

•  sorting  tasks  (Preece,  i976) 

tbe  first  three  techniques  are  the  most  coaaonly  used  and  vill  described  in 
the  following  paragraphs.  The  reader  Miy  wish  to  refer  to  Preece  for 
descriptions  of  the  latter  two  techniques. 

In  vord  association  tests  subjects  are  presented  with  a  stimulus  words  and  are 
aaked  to  respond  with  the  first  word,  or  all  the  words  that  they  can  think  of. 
Scores  that  are  generally  obtained  are  a)  the  total  nuaber  of  responses  to  a 
stiiulus  word,  h)  the  average  nuaher  of  responses  to  the  stivulus  words,  c) 
the  nuaber  of  responses  of  a  particular  kind,  and  d)  the  oveilap  of  response 
lists  for  pairs  of  concepts  (SbaTelson,  1974).   Hie  data  can  he  reduced  into  a 
aatrix  of  similarity  coefficients  irtuch  aay  in  turn  be  analyzed  statistically 
with  factor  analysis,  lultidiaensional  scaling,  or  hierarchical  cluster 
analysis. 

Vhen  using  the  second  technique,  construction  of  linear  graphs,  the  researcher 
asks  the  subjects  to  draw  a  ^sical  representation  of  a  set  of  concepts.  In 
this  technique  subjects  aay  be  given  very  directive  instruction  or  they  aay  be 
taught  a  graphing  technique  and  later  asked  to  use  it.  An  exaaple  of  directive 
instructions  sight  be 

Below  is  an  alphabetical  list  of  iO  teras.   Kead  the  list  carefully 
several  tines,   Froa  the  list  of  teras,  pick  the  two  teras  which  you  think 
are  "aost  siailiar"  to  each  other.   Write  the  pair  ycu  have  chosen  in  the 
■Iddle  of  the  page  and  connect  them  with  a  line.  Label  this  line  1.  Go 
carefully  over  the  reaaining  teras  in  the  list  and  pick  the  term  idiich  you 
think  is  Bost  similar  to  to  either  of  the  two  teras  you  have  already 
selected.   Label  the  connecting  line  2  .  .  .    (Shavelson,  i974). 

Subjects  aay  also  be  taught  a  graphing  technique  such  as  networking 
(Paneareau,  Collins,  UcDonald,  HOlley,  Garland,  Diekhoff ,  &  Evans,  1979)  or 
making  pattern  notes  (Buzan,  1974;  Jonassen,  1983)  prior  to  being  exposed  to 
the  learning  task.   After  experiencing  the  instructions^  treatments,  the 
subjects  can  be  asked  to  make  a  graph  of  the  content  usi^  the  newly  learned 
procedure. 

These  graphs  are  converted  to  syaaetric  proximity  matrices.   Tben  such 
statistical  techniques  as  cluster  analysis  and  multidimensional  scaling  may  be 
used  to  uncover  the  structure  unier lying  the  data.   Jonassen  reports  using  a 
the  program  iLSCAL  (Young  6  Lewyckyj,  1979)  the  scale  the  data. 

Jonassen  (1983)  describes  coaparing  the  representations  that  were  obtained 
using  pattern  nates  and  word  association  techniques.  He  found  that  "the 
clusters  produced  by  scaling  the  relatedness  coefficients  and  the  distances 
between  concepts  are  very  siailar. "  (p.  14) 
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fieseasrebers  using  the  third  technique,  slailaritr  ratings,  provide  subjects 
with  paired  concepts  and  ask  the  subjects  to  rate  tiae  concepts  as  to  their 
siiilarity.  For  exaiple,  the  subjects  night  be  asked  to  rate  tvo  concepts  on 
a  scale  of  one  to  ten  vith  one  being  'closest*  or  *iost  similar. *  These 
ratings  can  be  converted  to  proxiiitr  Mtrices  and  then  subjected  to  factor 
analysis  or  nultidiaensionBil  scaling  techniques.  Sone  indiTiduals  in  our  field 
mj  bSTe  recently  participated  in  Jonassen' s  stuly  vhich  collected  similarilty 
ratings  of  instructional  tedmology  and  related  te»s. 


Smiftcy 

Four  techniques  froi  cognitive  psychology  literatUTe  vere  described:  a) 
secondary  task  techniques  —  latency  data,  b)  eye-moreaent  records  eye 
fixations,  c)  int  respect  ire/ ret  rospectiTe  verbal  reports  ~  categories  of 
processing  activities,  and  d)  representations  of  cggnitives  structures  ~ 
indices  of  senantic  proxiiity.  The  characteristics  of  each  technique,  its 
advantages  and  linitations,  vere  discussed.   Ah  exaiple  from  instructional 
research  of  each  technique  vas  presented.  It  las  suggested  that  several 
techniques  can  used  together  to  get  a  profile  of  learners'  processing  and 
resulting  structures.   In  addition,  researchers  night  consider  using  these 
techniques  in  conjunction  vith  posttest  or  other  outcoae  inf  onation  in  order 
to  explain  the  results  the  are  Obtained. 

Inalysls  of  Current  Practice 

The  second  part  of  this  paper  reports  on  a  reviev  of  recently  reported 
research  in  our  field  to  ezanine  the  degree  to  lAdch  the  four  techniques 
described  earlier  have  been  used  in  studies  reported  in  AECT  publications. 

9ata  Source 

Articles  and  papers  published  in  Educational  Coiaunicatlon  and  Technoloov 
jfiyOfil  1983-1987  and  the  Proceedings  of  Selected  Research  Paper  Presentations 
at  the  (1983-1987)  Annual  ConventifflKs^  of  the  Asssociatlon  for  Educational 
Comnicetlona  and  Technoloov  vere  revieved.    Although  a  larger  saaple  of 
articles  night  have  given  a  more  accurate  profile  of  use  of  the  cognitive 
psychology  techniques,  I  considered  this  saaple  to  be  quite  adequate  for  an 
initial  exaiination  of  the  literature.   This  sanple  coaprised  17  issues  and  76 
articles  of  ECTJ  and  five  issues  and  208  articles  of  the  i30£fi£fifidj£gi-  ^ 
total  of  286  articles  vere  examined.   Of  these,  3  papers  vere  eliminated  as 
duplicates,  leaving  a  total  of  283  papers  for  reviev. 

Procadnre  mad  Kesults 

Each  paper  vas  revieved  and  categorized  vith  a  series  of  nested  categories. 
First,  it  vas  determined  vhether  the  article  vas  data-based.  One  hundred 
savwaty-lioiir  of  the  articles  vere  so  categorized.   Articles  that  did  not 
fall  in  this  category  vere  conceptual  and  advice-to-practice  in  nature.  These 
articles  vere  eliminated  from  further  analysis. 
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Seconl,  the  reiaining  articles  vere  categorized  as  to  vhether  they 
investigated  the  effects  of  an  instructioml  wriehle  or  instructional 
variables  on  leamiDg  outcoies.  One  mmlrad  am  saTenteeii  of  the  articles 
met  this  criterion.   For  the  purposes  of  this  studr*  articles  that  examined 
the  effects  of  an  instructional  program,  such  as  Logo,  or  an  instructional 
medium,  audi  as  media  coiparison  studies,  vere  elimiMted  from  this  category. 
Studies  that  did  not  fall  into  the  Instructional  variable  effects  category 
vere  eliminated  from  further  analysis. 

Vest,  the  117  articles  vere  examined  and  categorized  as  to  vhether  they 
explicitly  espoused  a  cognitive  psychology  theoretical  framevork.   To  be  so 
categorized  the  author(s}  must  have  explicitly  referenced  cognitive  processes 
or  structures  in  siibstantiating  predictions,  in  explaining  treatments,  or  in 
discussing  reeults.    Siztr-siz  articles  vere  included  in  this  category.  The 
articles  not  Included  in  the  category  used  other  theoretical  framevords,  such 
as  social  learning  thecHT'  used  previous  researdi  as  a  framevork;  predicted  or 
explained  results  in  terms  of  intuition  or  pragaatic  conclusions,  or  did  not 
include  a  framevork.  Articles  not  included  in  this  category  vere  not  analyzed 
further. 

Finally,  the  66  articles  vere  analyzed  as  to  data-gathering  techniques  and 
dependent  measures  to  ascertain  vhidi  used  the  four  tecbniques  described 
above.  Of  the  66  articles,  only  aiz  vere  so  categorized:  one  used  response 
latency  data,  three  used  eye  movement  data,  three  used  verbal  reports,  and 
none  used  mental  representations.  One  study  used  tvo  of  the  above  techniques, 
ao  vas  tallied  tvice.    It  Should  be  noted  that  several  of  the  articles  that 
did  not  reach  this  level  of  categorization  included  these  tecbniques,  (e.g., 
Jonassen' s  article  coaparing  the  mental  representations  achieved  through  vord 
association  and  pattern  notes  tecbniques).  An  examination  of  the  articles  did 
not  reveal  any  similar  techniques  not  included  in  the  previous  discussion  but 
appropriate  tecbniques  for  examining  cognitive  processing  or  structures.  The 
vast  majority  of  studies  classified  in  this  final  category  collected  only 
post test  data. 

Plsciission  mad  Conclvsion 

An  exulnation  of  283  articles  published  in  the  field  of  instructional 
technology  revealed  that  only  six  of  the  articles  that  examined  the  effects  of 
instructional  variables  on  learning  outcomes  and  claimed  a  cognitive 
psychology  framevork  used  the  techniques  described  in  this  paper.   Ihile  there 
■ay  be  some  error  in  categorizations,  this  finding  represents  a  fairly 
accurate  analysis  of  the  current  use  of  the  techniques  that  have  been 
suggested  in  cognitive  psychology  literature  as  indications  of  cognitive 
processing  and  cognitive  structures.  One  might  conjecture  as  to  liter  this  is 
the  case.   Sesearchers  in  the  field  may 

•  be  most  concerned  vith  the  ultimate  question     vhich  instructional 
variables  have  the  greatest  effect  on  performance? 

•  not  have  resources  and  training  to  eaploy  the  these  techniques, 

•  not  consider  the  information  that  these  data  provide  of  value,  or 

•  be  unavare  of  these  tecbniques  and  their  potential. 
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If  this  latter  conjecture  tee  any  Tallditr  (^ni  it  My  as  infonation 
datcrihiag  these  techniques  is  not  synthesized  in  any  source  that  I  located, 
vith  the  exception  of  a  brief  reriew  of  the  first  three  techniques  by  E. 
Gagna«  1985)  then  perhaps  this  paper  lay  proride  a  beginning  point  for 
researchers  to  exanine  the  techniques'  potential. 
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lb*  If  facts  of  OrganiMtioa  of  las  traction  on 
CognltlTe  Processing 


Traditional  models  of  instructional  design  (Gagne  S.  Briggs,  1979; 
Uerrill,  1984)  detail  specifically  hov  to  design  instructional  strategies  at 
the  nicro  level.     Ihis  is,  they  specify  the  sequence  of  events  that  should  be 
Included  in  instruction  toward  an  individual  objective.   For  Instance,  they 
suggest  that  vhen  teaching  toward  a  concept  objective,  the  izxstruction  should 
Include  a  verbal  statement  of  the  definition  of  the  concept,  examples  and 
nonexai^iles  of  the  concept,  and  an  opportunity  for  the  learner  to  classify 
exaiq)les  and  noneza^ples  according  to  the  concept's  definition. 

Yet,  design  models  rarely  suggest  strategies  for  organizing  instruction 
at  the  lesson,  \mit,  or  course  level.   To  date,  perhaps  the  most  frequently 
tised  strategy  for  organizing  instruction  at  these  m&cro  levels  is  the  learning 
prerequisite  sequence  suggested  by  Gagne  (1972).  Several  studies  have  examined 
the  effectiveness  of  instruction  designed  using  learning  hierarchy 
prescriptions  (e.g.,  Beeson,  1977;  Eustace,  1969;  Gagne,  1962;  Headley,  1971; 
ncCaln,  1971;  Okey,  S>  Gagne,  1970).   These  studies  typically  coMp^reA 
instructional  effectiveness  before  and  after  instruction  using  learning 
hierarchies  and  found  hierarchically-arranged  Instruction  to  be  generally 
st^erior  to  instruction  designed  using  other  means.   However,  such  an  approach 
may  yield  instruction  that  appears  piecemeal,  producing  learners  who  have 
acquired  individual  skills  and  bits  of  knowledge,  but  viho  have  failed  to 
acquire  the  "big  picture,"  a  fully  Integrated  schema  of  the  content. 

Instruction  organized  solely  by  prerequisites  are  generally  unresponsive 
to  the  unique  content  structures  of  particular  disciplines  Iherefore,  such 
models  may  fail  to  take  advantage  of  schemata  that  learners  have  already 
developed  from  encounters  with  traditional  content  structures  in  extant 
instructiOL>al  materials. 

Reigeluth  is  responsive  to  these  criticisms  of  traditional  design  models 
by  espousing  the  design  of  instruction  based  iqion  his  Elaboration  Theory  of 
Instruction.    The  Elaboration  Theory  suggests  that  designers  should  begin  the 
design  of  instruction  by  selecting  an  overriding  organizational  structure: 
conceptual,  theoretical  (based  i^on  principles),  or  procedural.   It  further 
airports  a  method  of  sequetlicing  instruction  from  the  most  siif>le  and  inclusive 
Ideas  in  the  content  to  the  most  complex  and  specific  ideas.   Reigeluth  has 
borrowed  the  basis  of  this  simple-to-co^>lez  pattern  from  Bruner's  (1960) 
Ideas  of  a  spiral  curriculum,  from  Ausubel's  (1968)  assimilation  theory,  and 
from  Vorman's  (1973)  concept  of  web  learning. 

The  Elaboration  Theory  predicts  that  instruction  designed  on  its 
principles  will  result  in  a)  more  fully  Integrated  schemata,  resulting  in 
better  retention  and  transfer  at  the  application  level;  b)  higher  levels  of 
learner  motivation;  and  c)  more  efficient  Instruction  based  tq;>on  greater 
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learner  control  of  selection  and  sequencing  of  content  tban  materials 
dereloped  using  more  traditional  macro  strategies  (Seigeluth  ^,  Stein,  i983). 


Bovever,  empirical  studies  have  failed  to  fully  si^port  these  predictions 
(BeUlcbo£.1986;  Keigeluth  &  Stein).   One  possible  reason  for  tbis  failure  is 
that  researchers  have  not  examined  a  full  range  of  data  sources  lAxen  examining 
the  differences  betveen  performances  of  learners  encountering  materials 
designed  according  to  the  Elaboration  Iheory  versus  more  traditional 
approaches.    Smith  and  Wedman  (1986)  proposed  a  number  of  additional  data 
sources  that  might  be  sufficiently  sensitive  to  examine  some  of  fieigeluth's 
predictions. 

The  purpose  of  the  current  study  vas  to  compare  the  effects  of  an 
elaborated  unit  of  instruction  versus  a  hierarchical  unit  on  studants  "on- 
line" processing  activities,  efficiency  of  encoding  nev  information  vlthin  the 
lesson,  and  facility  in  solving  practice  problems. 


llethod 

Participants.  Six  university  graduate  students  in  the  College  of 
Education  at  a  xmiveristy  in  the  southwest  who  were  rated  as  novice  on  the  to- 
be-learned  content  (scoring  less  than  3  on  a  15  item  pretest)  participated  in 
this  study.    Students  were  randomly  assigned  to  either  a  hierarchical  or  an 
elaborated  version  of  the  Instruction  (three  students  to  each  treatment). 

Baterlals.   Two  versions,  a  hierarchical  verson  and  a  modified 
elaborated  version,  of  a  xxnit  on  Principles  of  Photography  were  developed. 
Both  versions  were  developed  to  teach  toward  the  objective  "Learners  will  be 
given  a  setting  (shutter  speed  and  f-stop)  that  will  yield  a  correct  exposure 
and  a  clear  imoige  and  a  chenging  condition  (lighting,  motion,  field  of  view, 
or  film  speed).     They  will  be  able  to  determine  a  correct  setting,  film 
speed,  or  other  accommodations  that  will  yield  a  correctly  exposed,  clear  shot 
under  the  changed  condition." 

Ihe  elaborated  version  consisted  of  105  pages;  the  hierarchical  version, 
80  pages.    The  content  that  was  indicated  in  an  Instructional  analysis  to  be 
prerequisite  to  learning  the  terminal  objective  was  present  in  both 
treatments.   Both  sets  of  materials  contained  sequences  of  information 
presentation,  practice  items,  and  feedback. 

The  elaborated  version  contained  an  epitome,  which  introduced  the 
variables  (e.g.,  amount  and  duration  of  exposure)  that  affect  picture  quality 
and  the  relationship  of  these  variables  within  an  analogy.    The  epitoke 
required  the  students  to  make  non-numerical  predictions  about  the 
relBitionships  of  these  variables  within  specific  contexts.   The  second  part  of 
the  elaborated  version  introduced  the  numeric  values  associated  with  the 
previously-introduced  variables  and  the  numeric  relationships 
between  these  variables.   It  also  included  synthesizers  that  tied  each  section 
of  the  second  part  of  the  unit  to  the  epitome.    The  elaborated  unit  did  not 
include  the  following  aspects  of  elaborated  instruction:  summarizers. 
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cognitiTe-strategr  activators,  am  explicit  invitations  to  exercise  learner- 
control. 

hierarchical  Tersion  introducwl  each  principle  ot  creating  quality 
photographs  (e.g.,  correct  exposure,  clarity,  etc.)  and  its  related  concepts 
in  a  sequence  indicated  hy  an  instructional  analysis.  A  i5-iten  pretest  that 
contained  near  transfer  items  las  administered  to  all  participants.  In 
addition,  70  embedded  practice  items  vere  constructed  to  evaluate  vithin- 
instruction  learning  (seven  in  the  targeted  section  of  instruction). 

Procedure.    Participants  vere  introduced  to  the  study  and  agreed  to 
participate.    Although  they  had  been  previously  screened  to  ascertain  that 
they  vere  essentially  novices  in  the  content,  they  all  completed  a  pretest. 
*Ihey  vere  then  trained  and  alloved  to  practice  a  read-thizdc-aloud  procedure  in 
v/tdch  they  read  the  content  aloud  and  attempted  to  make  oral  any  thought 
processes  that  occured  as  they  interacted  vith  the  materials. 

After  the  experimenter  vas  satisfied  that  the  participant  could  use  the 
procedure,  the  participant  vss  presented  vith  the  first  part  of  the  materials, 
the  tape  recorder  vas  started,  and  the  student  began  to  read  and  interact  vith 
the  Miterials  aloud.   If  the  participant  began  to  be  silent,  (s}he  vas 
prompted  "i^t  are  you  thinking  /reading  nov?"    After  the  student  co;4)leted 
Fart  1  (approximately  30-60  minutes}^  <s}he  vas  given  a  15-minute  breaX. 
After  the  break,  the  student  vas  reminded  to  "read  and  think  aloud"  and  the 
tape  recorder  veis  started  again.   A  break  folloved  Part  2  (approximately  30-45 
minutes),  then  Part  3  vas  coi4>leted  (30-45  minutes).  Entire  instructional  time 
ranged  from  tvo  to  three  hours.  As  a  comperison  of  posttest  performance  vas 
not  of  interest  in  this  particular  study,  no  posttest  vas  given. 

Scoriag.    The  read- think-aloud  protocols  vere  transcribed.    Due  to  the 
Yolume  of  the  data,  only  one  section  of  these  protocols  vas  analyzed  in  this 
study.   The  researchers  predicted  that  the  difference  in  the  effects  of  the 
tvo  treatments  vould  be  greatest  at  the  point  in  vhich  the  learners  vere 
required  to  manipulate  a  number  of  variables  mentally  a^  one  time.  Therefore, 
the  segment  of  instruction  that  Included  the  information  presentation, 
practice,  and  related  feedback  on  determining  equivalent  exposures  vas 
selected  for  this  Initial  analysis. 

First  the  protocols  vere  examined  for  patterns  of  responses  in  the 
foUoving  areas:   generation  of  exai^les,  inferences,  coi^Mirisons,  analogies, 
mnemonics,  paraphrases,  misconceptions  and  their  rectifications, 
summarization/ reviev/ rehearsal,  self -monitoring,  rereading,  imaging  and 
questioning.   Frequencies  and  durations  of  the  above  activities  and  their 
location  vithin  the  materials  vere  noted.   During  the  analysis  of  these 
protocols  the  folloving  categories  of  elaboration  emerged:  confusion, 
question,  repeat/ reread,  paraphrase,  elaborated  paraphrase,  retrieve  concept 
Cifiisitim,  retrieve  rule,  summary,  prediction,  rule  expansion/  application, 
tie  to  prior  knovledge,  exai^jle. 

Time  for  encoding  the  nev  information  presented  in  the  targeted  section 
am  total  learning  time  for  the  package  vere  recorded.  In  addition,  the  nuaber 
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of  correct  responses  to  the  practice  questions  In  the  targeted  section  vas 
calculated. 


Elaborations.  Table  1  suiMarizes  the  frequencies  of  processing  types 
for  the  hierarchical  and  elaboration  groins. 


As  can  be  noted  from  th£  above  Taible  participants  responding  to  the 
hierarchical  version  performed  many  more  elaborations  than  participants 
responding  to  the  elaborated  version. 

Practice  Ites  perf  onaace.    Of  the  7  eibedded  Items  the  average 
performance  of  the  hierarchical  groiq>  vas  5. 3,  of  the  elaboration  group  vas 
4.3. 

Time  (facility)  eacoding.  Ihe  average  reading  time  of  the  targeted 
section  for  the  hierarchical  group  vas  8.3  minutes,  of  the  elaboration  giovp 
vas  6.0. 


Discussion  and  ConclnsioBA 

Of  greatest  interest  in  this  set  of  data  are  the  elaborations  and  the 
encoding  times.   Ihe  differences  betve^en  number  and  type  of  elaborations  bears 
further  investigation.    It  may  be  that  as  participants  in  the  hierarchical 
group  had  not  had  a  cognitive  structure  built  through  an  epitome  (as  the 
elaboration  groiQ)  may  have)  they  needed  to  make  a  greater  number  of 
elaborations  to  build  this  schema. 

The  differences  In  encoding  time  for  this  section  were  as  predicted.  It 
vas  conjectured  that  learners  that  had  been  exposed  to  the  epitome  vould  be 
more  facile  In  encoding  nev  Information  because  they  vould  already  have  a 
cognitive  structure  of  the  basic  relationships  axiong  variables  into  ^ch  the 
more  detailed  information  could  "hook. "  Therefore,  It  was  expected  that  the 
elaboration  giovp  would  take  less  time  in  encoding  this  information  than  the 
hierarchical  group  who  vould  have  to  build  the  cognitive  structure  of 
relationships  as  they  encoded  the  nev  information.    The  fairly  substantial 
difference  In  encoding  times  seems  to  s\9port  this  conjecture. 

The  time  of  encoding  and  nuBber  of  elaborations  seem  to  sipport  each 
other  and  the  conjectures  as  to  the  function  of  the  elaboration  in  the 
instruction.   Hovever,  conclusions  from  this  study  must  be  yery  tentative  due 
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to  the  sBall  nmber  of  participants.  Future  Investlaatlons  my  examine  this 
relationship  aore  closely. 

In  addition,  future  studies  in  this  area  >ay  wish  to  ezaKine 
participants'  mental  representations  of  the  content  hy  training  them  in  a 
networking/pattern  notes  strategy  and  asking  them  to  summarize  the  content 
that  they  have  read  in  these  forms.   A  comparison  of  the  notes  created  by 
participants  in  elaborated  and  hierarchical  groiq)s  might  lead  to  some 
conclusions  as  to  vhether  the  prediction  of  more  integrated  schemata  resulting 
from  elaborated  instruction  can  be  substantiated.    Other  researchers  may  vish 
to  examine  the  interactions  betveen  level  of  prior  knowledge  or  processing 
style  (such  as  idiolist/serialist}  asd  effectiveness  of  elaborated/hierarchical 
instruction.   Certainly,  future  investigations  should  expand  elaborated 
versions  to  include  many  levels  of  elaboration  and  all  definitive 
characteristics  of^  elaborated  instruction. 
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1U>le  1 

Frequency  of  Elaborations  in  Specific  Categories  for  Participants  in 
Hierarchical  Versus  Elaboration  Groups 


Troe  of  Elaboration 

Hierarchical 

Elaboration 

Confusion 

3 

0 

Question 

5 

1 

Repeat/reread 

1 

2 

Paraphrases 

7 

2 

Elaborated  paraphrases 

2 

1 

Ketrleve  concept  definition 

1 

0 

Retrieve  rule 

1 

0 

Suuary 

1 

2 

Prediction 

5 

1 

Rule  expansion/application 

3 

0 

Tie  to  prior  knowledge 

3 

0 

Example 

0 

1 
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lOfiBS  A  TAZDMIIT  Of  riEDBACK:    COREIT  UD  SCHEDOLIIG 


Hie  tvo  dimensions  of  feedback  tbat  vill  be  discussed  in  this  paper  axe  content 
and  scheduling.   Each  dimension  and  the  elements  vithin  each  dimension  vill  be 
defined,  some  general  conclusions  from  the  research  investigating  the  elements 
vill  be  discussed,  and  further  questions  vith  regard  to  further  researtch  vill  be 
identified.   Greatest  attention  vill  given  to  the  first  dimension,  content,  as  a 
subsequent  paper  vill  discuss  it. 

Coateiit 

The  content  of  feedback  refers  to  the  composition  of  the  information  provided  to 
a  learner  after  his/her  response  to  a  question  vithin  an  instructional  sequence. 
The  effectiveness  of  different  types  of  feedback  content  has  been  probalbly  the 
most  researched  issue  in  the  area  of  feedback.  TVo  major  categories  of  ifeedback 
vhich  hBiTe  been  researched  are  Botivational,  reinforcing,  feedback  aM 
infoniative,  corrective,  feedback. 

Hotivational 

Hotivational,  reinforcing,  feedback  is  information,  lAiich  may  include  praise  or 
other  revards,  that  follovs  a  correct  response.  The  feedback  message  may.  Include 
only  a  right/correct  message,  similar  to  Xnovledge  of  Results  feedback  vfiiich 
follovs  a  correct  ansver.   In  general,  studies  of  this  element  have  not  ozamined 
"punishing*  feedback  folloving  incorrect  responses.  The  purpose  of  motiveitional 
feedback  is  to  reinforce  correct  responses,  and,  thereby,  increase  the 
repetition  of  correct  responses,   hotivational  feedback  vas  the  first  type 
content  feedback  that  vas  researched,  vith  much  of  this  research  being  conducted 
vith  programmed  instruction  and  vithin  the  theoretical  f  ramevork  of  behaviorism. 

Vhile  there  are  a  f ev  studies  (e.g. ,  Caiq)eau,  i968}  that  si^port  the  efficacy  of 
reinforcing  feedback  over  no  feedback,  the  majority  of  studies  in  this  category 
(e.g.,  Becker,  1964;  Feldbusen  &  Birt,  1962;  Hough  &  Bevsin,  1963;  Jacobs  & 
Xulkami,  1966;  Lasoff ,  1981;  Uoore  8.  Smith,  1964)  have  found  no  significant 
effects  of  confirmatory  feedback  or  confirmatory  feedback  vith  praise  over  the 
no  feedback  condition. 

Extensive  discussion  in  the  literature  has  centered  around  a)  vhether 
confirmatory  feedback  is  indeed  reinforcing  and  b)  vhether  confirmatory  feedback 
is  a  potent  variable  in  instruction.   Sassenrath,  1975),   Sassenrath  &  Tounge, 
(1969),  and  Bardvell  (1981)  concluded  that  confirmatory  feedback  did  not  serve 
as  a  reinforcer  of  correct  performance.   Smith  aad  Smith  (1966)  suggested  that 
confirmatory  feedback  vill  not  serve  as  reinforcement  imless  learners  alvays 
make  correct  responses. 

In  general,  most  current  research  on  feedback,  vhich  is  based  upon  cybernetic 
psychology  and  information  processing  theory,  suggests  that  feedback  serves  an 
informational,  error  detecting  and  correction  function,  rather  than  a 
reinforcement  function  (immons,  1956;  Smith  S.  Smith,  i9S6}  and  that  feedback  may 
be  more  effective  after  incorrect  responses,  rather  than  correct  ones  (Carter, 
1984;  Cohen,  1985;  Eulhavey,  1977,  Phye,  1979). 
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lafonMitioml  fsadlMck 

Inf ozaational,  often  corrective  feedback,  is  intonation  that  is  provided  to 
learners  folloving  their  response  to  question  vithin  an  instructional  sequence. 
Tbis  tTpe  of  feedback  provides  learners  vith  infonation 

•  about  the  adequacy  of  their  responses,  and/or 

•  that  helps  then  to  detect  and  correct  their  errors  and  misconceptions,  and/or 

•  that  helps  them  to  understand  vby  a  particular  correct  ansver  is  correct. 

Tb»  primary  purpose  of  informational  feedback  is  error  detection  and  correction 
in  order  to  reduce  the  potential  of  an  error  occurring  during  future 
performance.   While  the  effects  of  informational  f ee^ck  has  been  studied 
folloving  both  correct  and  incorrect  responses,  the  majority  of  studies  have 
focused  on  the  efficacy  of  informational  feedback  folloving  incorrect  responses. 

Informational  feedback  has  been  subdivided  into  a  variety  of  categories  (Carter, 
1984;  Soper,  1977;  Sales.  1983).   TD  simplify  these  categories,  this  paper  vlll 
refer  to  four  major  types  of  informational  feedback:  a)  no  feedback,  b) 
"correct/incorrect"  message,  c)  presentation  of  correct  ansver,  d)  elaborative 
feedback.   Ihe  variations  vithin  each  category  and  the  conclusions  of  related 
research  vill  be  discussed  in  subsequent  sections. 

■o  f eedliack.   This  category  of  feedback  is  obvious.  Instructional 
treatments  that  contain  no  feedback  do  not  provide  information  either  implicitly 
or  explicitly  about  the  accuracy  of  response  or  explanation  of  correct  or 
incorrect  responses.   Occtiisionally,  programs  do  not  present  verbal  statements  of 
feedback,  but  implicitly  give  learners  information  about  the  accuracy  of  their 
responses  (e.g..,  a  program  that  establishes  the  'set'  that  idien  ansvers  are 
correct  the  program  vill  continue  vith  the  next  frame  of  information. )  Such 
programs  do  not  truly  reflect  the  'm  feedback'  category. 

Leame/rs  vho  do  not  receive  feedback  during  instruction  must  complete  all  of 
the  folloving  processing  on  their  ovn: 

•  las  I  right/vrong? 

•  What  is  the  correct  ansver? 

•  If  I'm  vroog,  vby? 

•  Ihy  is  the  correct  ansver  correct? 

•  Hbv  can  I  find  out  vhy  (I'm  vrsng  or  right}? 

•  Hov  am  I  doing  in  this  lesson? 

Barringer  and  Oiolson  (1979)  concluded  from  a  reviev  of  the  feedback  literature 
that  'no  feedback-  conditions  consistently  receive  the  lovest  scores  on 
criterion  measiures  in  contrast  to  other  forms  of  feedback. 

'Corrmct/ittcorrect"  message.    Feedbadc  of  this  type  tells,  learners, 
either  explicitly  or  implicitly,  vhether  their  responses  are  correct  or 
incorrect.    (This  is  often  referred  to  the  literature  as  Knovledge  of  Results 
(KOK)  feedback.)  The  most  common  form  of  this  message  is  'Sight'  or  'frong'. 
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studies  indicate  tbat  KOR  feedteck  is  si^erior  to  no  feedback  (Roper, i977; 
Schiiael,  1983).  This  my  be  because  the  first  processing  requireaent 

•  Vats  I  right/vrong?  V 

•  Ibat  is  the  correct  ansver? 

•  If  I'm  vrong,  iSxy? 

•  Ihy  is  the  correct  ansYer  correct? 

•  Hoy  can  I  find  out  ibr  <I'&  vrong  or  right)? 

•  Bov  am  I  doing  in  this  lesson? 


is  proTided,  decreasii^^  the  leamere'  cognitive  processing  load.   Tbe  no 
feedback  condition  places  a  heavy  load  a)  learning  nev  content  and  b)  a  high 
level  of  strategy  use,  such  as  self-monitcring  aid  inferencing  on  the  limited 
capacity  of  working  memory.   The  "correct/incorrect"  feedback  reduces  the  demand 
by  reducing  the  amount  of  inferencing  tliat  must  occur. 

Presemtetioa  of  correct  amsvor.  This  form  of  feedback  informs 
learners  of  the  correct  ansver  to  the  question  they  have  just  ansver ed.  (This 
type  of  feedback  is  often  called  KOI  in  the  literature.  Hovever,  some  studies 
use  XCS  to  represent  confirmatory  feedback  after  correct  ansve^s.  The  label  tCR 
vill  not  be  used  in  this  paper. )  The  majority  of  research  indicates  that  this 
type  of  feedback  is  superior  to  correct/incorrect  feedback  or  no  feedback, 
especially  irtien  it  follovs  incorrect  responses  (e.g.,  Gilman,  1969).  Correct 
eiisver  feedback  i>upplies  the  foUoving  processing  required  of  a  learner: 

•  iBis  I  right/vrong?  (^} 

•  Vhat  is  the  correct  ansver?  V 
«  It  I'm  vrong,  vhy? 

'■9  1!hy  is  the  correct  answer  cort^'Ct? 

•  Ho^i  can  X  find  out  vh?  (I'm  vroDg  or  right)? 

•  Hov  a]b  X  dping  In  this  lesson? 

The  inf  ermice  th&v  learners  must  lako  given  the  correct  ansver  as  to  ihether 
thei::  ansver  is  ri^ht  or  vrong  see;?s  i  fairly  straightforvard  and  undeianding 
comparison  of  response  to  correct  ansver.    This  inference  ("Am  I  right/vrong?") 
probably  requires  littlo  cognitive  ef  f  ort>  especially  if  the  learners'  responses 
are  available  on  the  same  frcme  as  the  feedltack. 

ElabormtiTo  f oodtmck..  Elaborative  feedbadc  includes  tuuae  more  coiplez 
forts  of  feedback  that  explain,  direct,  or  monitor.  They  may  or  m&y  not  be  used 
in  conjunction  vith  KOP  or  correct  ansver  feedback. 

KxplMamtprr  i»&dbmck.  This  category  includes  f  eedbadc  that  explains  idiy  a 
correct  ansver  is  correct  and/ or  vhy  an  incorrect  question  is  incorrect. 

•  liis  I  right/vrong?  (^) 

•  Vbat  is  the  correct  ansver?  (V) 

•  If  I'm  vrong,  vhy?  4 

•  Vhy  is  the  correct  ansver  correct?  V 

•  Hov  can  I  find  out  vhy  (I'm  vrong  or  right)? 

•  Hov  am  I  doing  in  this  lesson? 
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ExpUmtioa  of  vfay  «n  istcorrect  axunrer  is  incorrect  or  vhj  *  correct  ansver  is 
correct  lay  be  presented  separately  or  together  in  the  same  f  eedtark. 
Ezplanatorr  f eedteck  aay  (or  my  not)  include  a  stateient  of  vhether  learners 
are  correct  or  incorrect.   It  mj  (or  mj  not)  Include  a  presentation  of  the 
correct  ansver.   If  only  an  explanation  of  why  an  incorrect  answer  is  incorrect 
is  giTen*  the  correct  ansver  and  vby  it  is  correct  vill  have  to  he  inferred. 

Occasionallr.  as  in  a  siiulation,  this  type  of  feedback  mj  explain  an  incorrect 
or  correct  ansver  by  revealing  the  consequences  of  that  ansver  (e.g.,  "no,  if 
you  reradjust  the  Mster  lever  at  this  tine,  the  spockets  will  catch  on  the 
socoodary  gear"). 

Pirwctivw  Directive  feedback  way  cue  or  proipt  learners  as  to 

strategies  to  detenlne  the  correct  ansver,  giving  suggestions  as  to  solve  a 
problen,  as  in  Landa's  (i974}  algoritbaic  feedback,  or  vfaere  to  direct 
attention,  as  in  Uerrill  and  Tennyson's  (1977)  attribute  isolation  feedback. 
Directive  feedback  night  be  as  subtle  as  a  branch  to  reviev  frames  in  a  lesson, 
directing  learners  to  the  information  that  they  have  failed  to  understand. 
Directive  feedback  generally  follovs  incorrect  responses,  although  theoretically 
some  directive  feedback  types,  such  as  attribute  isolation  feedback,  could 
follov  correct  ansver^. 

•  Vas  I  right/vrpng? 

•  Ibat  is  the  correct  ansver? 

•  If  I'm  vrong,  vfay? 

•  Vhy  is  the  correct  ansver  correct? 

•  Bov  can  I  find  out  idxy  (I'm  vrong  or  right}?  V 

•  Hoy  am  I  doing  in  this  lesson? 

Directive  feedback  is  often  used  in  conjunction  vith  interactions  that  allov  for 
a  second  try. 

MoMZ^^TJia^  fw&atack.    hr.tnitoring  feedback,  sometimes  called  advisement 
(Sales,  1985),  provides  learners  vith  information  as  to  hov  veil  they  are 
performing  in  the  lesson.    Such  feedback  might  inform  learners  hov  close  they 
are  to  a  criterion,  such  as  mastery.   This  type  of  feedback  somevhat  supplants 
the  metacognitive  strategy  of  self -monitoring. 

a  las  I  right/vrong? 

•  What  is  the  correct  ansver? 

•  If  I'm  vrong,  lAy? 

•  Ihy  is  the  correct  ansver  correct? 

•  Hov  can  I  find  out  lAy  (I'm  vrong  or  right)? 

•  HOV  am  I  doixig  in  this  lesson?  V 


Despite  investigators  attempts  to  establish  that  elaborative  f eedbadc  is  more 
effective  than  less  complex  feedback,  thus  far,  data  has  generally  failed  to 
support  their  claims  (Schimmel,  1983,1987).   This  finding  may  be  due  tG  tvo 
different  factors:   complex  interact  ^ns  and  counterbalancing  cognitive 
processes. 
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Complex  &it»r«ctioB« 

SesMrchers  ia  the  area  of  feedback  are  begixmiag  to  realize  that  the  quest  to 
find  the  siogle  best  feedback  treatment  orerall  mj  be  less  siiple  than  it  once 
appeared.   Tbere  are  auqr  factors  that  my  interact  vith  the  instructional 
irarlable,  feedback,  ihich  mj  Mke  its  effects  differential. 


insert  Figure  1  about  here. 


Particularly  critical  to  the  effectiveness  of  feedback  lay  the  variables  of  type 
of  learning  task,  learner  characteristics,  instructional  event  being  delivered, 
and  the  type  of  perf  onance  measure. 

Instructional  events  becaie  apparent  as  a  confounding  variable  as  the  author 
revievad  the  current  literature.   Feedback  studies  investigate  feedback  after 
pretests,  during  practice,  after/during  tests.   As  the  function  of  these  events 
are  quite  different,  it  seens  that  feedback  aust  function  differently  in  these 
events  as  veil.  Findings  in  the  area  of  feedback  lay  seem  so  equivocal  because 
of  revievers  attempts  to  generalize  results  across  completely  different 
Instructional  events.  Once  these  potentially  interacting  factors  are  crossed 
vith  the  elements  of  the  various  of  dimensions  of  feedback  presented  in  this 
seminar,  it  is  clear  that  this  area  of  study  may  be  very  complex  Indeed. 

ComiterlMlancliig  CognitlTe  Processes 

Is  can  be  seen  In  Figure  2  there  are  tyo  counterbalancing  factors  of  cognitive 
processing  that  may  sometribat  explain  the  unexpected  findings  relative  to  the 
potency  of  elaborative  feedback 


Insert  Figure  2  about  here. 


As  can  be  seen  on  the  left  side  of  the  scales,  the  more  complex  the  feedback, 
thm  more  processing  information  regardirg  the  questions 

•  les  I  right/wrong? 

•  Ibat  is  the  correct  ansver? 
«  If  I'm  wrong,  vhy? 

•  Ihy  is  the  correct  answer  correct? 

•  Hov  can  I  find  out  vhy  (l/m  vrong  or  right}? 

•  Hov  am  I  doing  in  this  li'sson? 

it  provides,  the  less  of  the  limited  capacity  of  working  memory  must  be 
dedicated  to  'figuring  out'  the  ansvers  to  these  questions,  and  the  greater  the 
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aioimt  of  vorklag  leiorr  can  be  allocated  to  the  new  content  of  the  lesson 
ittelf .   Tlierefore,  one  vould  predict,  as  aany  researchers  have,  that  the  more 
coi^lez  the  feedhack,  the  greater  the  learning.   Hoverer,  theoretically,  the 
•ednnisi  is  not  as  siaple  as  this. 

As  can  be  seen  cm  the  right  side  of  the  figure,  the  less  infonation  that  is 
presented  to  learners  in  feedback  the  lore  processing  that  are  required  to  do  in 
order  to  answer  the  processing  questions 

•  Isis  I  right/vrong? 

•  that  is  the  correct  answer? 

•  If  I'm  wrong,  why? 

•  Ihr  is  the  correct  answer  correct? 

•  How  can  I  find  out  why  (I'm  wrong  or  right}? 

•  BOW  am  I  doing  in  this  lesson? 

This,  to  a  point,  leads  to  a  greater  depth  of  processing  (Craik  &  Lockhart, 
1972}  iMch  in  turn  leads  to  greater  learning  and  retention  (Craik  d  THaving, 
1975).   fittrock  (1974}  refers  to  this  phenomenon  as  the  generatiT8  effects 
of  learning.  Ihen  learners  are  asked  to  supply  more  of  the  processing,  rather 
than  having  it  supplanted  by  Instruction,  Uiey,  to  a  point,  learn  and  recall 
more.   Therefore,  with  this  theoretical  perspective,  the  order  of  the  predicted 
effects  6f  the  different  types  of  feedback  is  rerersed,  with  "no  feedback" 
predicted  as  being  the  most  effectlTe  form  of  feedback  as  it  requires  the 
greatest  processing.   The  general  conclusions  of  feedback  literature  may  serve 
as  an  indication  of  where,  orerall,  the  balance  of  these  counterbalancing  force, 
•tip". 

&8  feedback  <  KOI  <   correct  ajkswer  >  elaboriitiTe 

Ihe  pattern  of  greater  complexity  of  feedback  leading  to  greater  learning  gains 
does  not  continue  through  elaboratlTe  feedback.   The  pattern  breaks  between 
correct  answer  feedback  and  elaboratlTe  feedback.    It  may  be  that  at  this  point 
(for  most  learners,  for  most  tasks,  for  most  events,  for  most  performance 
measures}  the  benefit  of  the  depth  of  the  processing  required  of  making 
inferences  from  the  given  feedback  infcraation  (correct  answer}  may  outweigh  the 
cognitive  capacity  payoff  of  providing  the  more  complex  feedback.  The  puxzling 
out  of  lAy  an  incorrect  answer  is  incorrect  and  why  a  correct  answer  is  correct 
lay  be  a  function  that  learners  need  to  supply  themselves. 

This  conjecture  has  not  been  fully  tested  with  extant  data,  much  less 
investigated  with  new  studies.     It  may  have  some  benefit  to  explaining  some  of 
the  equivocal  findings  in  thu  literature. 

ScHedullxig 

This  dimension  refers  to  the  decisions  as  to  how  often  feedback  will  be 
provided  to  learners  within  an  instructional  sequence.    Scheduling  is  distinct 
from  another  dimension,  timing,  which  generally  refers  to  when  feedback  will  be 
presented  in  relation  the  learners'  response  (e.g. ,  immediate,  delayed}.  In  most 
studies  of  feedback,  the  feedback  immediately  follows  the  response.   However  , 


ERIC 


738 

725 


ibis  pattern  can  be  altered.  Tbere  are  three  MHor  categories  of  scheduling. 
FeedtMick  can  be  prorided 

•  for  eacb  itan 

•  for  a  certain  percentage  of  Iteas 

•  after  a  certain  nuaber  of  correct/incorrect  itens. 

For  Mch  ita».    Host  of  tbe  studies  that  vere  discussed  earlier  vith 
regard  to  content  utilized  tbis  form  of  f eedtack,  proridlog  ibicberer  f orm(2^)  of 
feedback  being  inrestigated  after  each  itea.   Ibis  is  a  coaaon  pattern  for 
presentation  of  inf onatiooal  feedback. 

For  o  cortaiA  percoBtage  of  itens.  Feedback  on  a  percentage  schedule 
proiTides  feedback  for  onlr  a  certain  percentage  of  tbe  iteaj  (e.g.,  20K,  iW, 
etc).  Feedback  ary  be  raadoBlT  apportioned  according  to  this  percentage,  or 
on  a  Iliad  s^edule  (e.g.,  after  ersry  third  itea). 

After  a  certain  mabar  of  cerreci/incorrac    /twm».  Feedback  of  this 
type  generally  presents  cuaulatlTe  Inf onation  after  a  learner  has  aiosvered  a 
set  nuaber  of  iteas  correctly  or  incorrectly  (e.g. ,  "Good  you  gotten  6  iteas 
correct. ') 

Udst  of  tbe  research  with  scheduling  seens  to  utilise  lotirationBil,  reinforcing, 
conf iraatory  feedback.   This  is  consistent  vith  the  befaaTi&rist  theoretical 
groundings  ibicb  underlie  botb  aspects.   Schedules  of  reinf  orceaent  bare  been 
exaained  extensiTsly  in  the  literature,  fith  regard  to  feedback.,  findings 
contrasting  schedules  of  reinforceaent  hare  generally  yielded  nonsignificant 
results.   Two  contrasting  studies  were  Lublin's  (1965)  in:vestigation  tlMt  found 
that 

no  feedback  >  variable  feedback  >  fixed  feedbackback  > 
correct  answer  after  every  itea 

and  Xruabolts  and  Keisler  (1966)  who  found  that  low  ratios  of  feedback,  such  as 
for  lOX  or  2m  of  the  iteas  resulted  in  lower  perforaence  then  higher  ratios, 
such  as  60K  or  lOOK.    It  aight  be  profitable  to  ezaaine  these  findings  within 
Inf orMtion  within  infonation  pirocessing  theory,  perhaps  explaining  the  results 
as  effects  of  learners'  expectations  or  level  of  effort. 
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Figure  1.  Model  of  Variables  in  Complex  Inleracllons. 


Task  X    Event  X  Feedback  X    Learner  Characteristic  =    Performance  Measure 

Variable 
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FiqurQ  2.     Model  of  counterbalancing  processes 
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nxonoAT  of  Content 


Content 

Hie  content  of  feedtack  refers  to  the 
coiposition  of  the  inf  onation  provided  to  a 
learner  after  his/her  respohse  to  a  question 
vithin  an  instructional  sequence. 

notivatioiMil 

Uotivational,  reinforcing,  feedback  is 
inf  onation,  ihich  lay  include  praise  or 
other  rewards,  that  follows  a  correct 
response. 

Infornctional 

mforaational,  often  corrective  feedback,  is 
inf  onation  that  is  provided  to  learners 
following  their  response  to  question  within 
an  instructional  sequence. 

•  Mq  feedback 

Tbis  category  of  feedback  is  obvious. 
Instructional  treatMents  that  contain  no 
feedback  do  not  provide  inf  onation  either 
iiplicitlr  or  explicitly  about  the  accuracy 
of  response  or  explanation  of  correct 


Feedback  of  t^.i.s  type  tells  learners,  either 
explicitly  or  iiplicitly,  whether  their 
responses  are  correct  or  incorrect,  or 
incorrect  responses. 

•  Correct  answer 

This  fon  of  feedback  informs  learners  of 
the  correct  answer  to  the  question  they  have 
just  answered. 

•  IlaboratxTe 

Elaborative  feedback  includes  those  more 
coaplex  fons  of  feedback  that  explain, 
direct,  or  monitor.   It  may  or  may  not  be 
used  in  conjunction  with  KOS  or  correct 
answer  feedback. 

This  category  Iticludes  feedback  that  explains 
lAxy  a  correct  answer  is  correct  and/or  why  an 
Incorrect  question  is  incorrect. 
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Directive  feedback  say  cue  or  proipt  learners 
as  to  strategies  to  deteraine  the  correct 
anaver 

Uouitoriag  feedlmck,  soaetimes  called 
adViseaent,  provides  learners  vith 
inforaation  as  to  hov  veil  they  are 
perfoning  in  the  lesson. 
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l^zoBomy  of  Scbettviliig 


Scaduling 


«Item  hf  itea 


Diis  dimension  refers  to  the  decisions  as  to 
how  of  ton  feedback  vill  be  provided  to 
learners  vitbin  an  instructional  secjuence. 


Feedback  presented  after  each  itea.or  each 
item. 


•  Porcenta^ro 
Scheduling 


•  CunulatiTO 


Feedback  on  a  percentage  schedule  provides 
feedback  for  only  a  certain  percentage  of  the 
iteas  (e.g.,  20K.  iW,  etc).   Feedback  lay  be 
rondonly  apportioned  according  to  tMs 
percentage,  or  on  a  f  izea  schedule  (e  g. , 
after  every  third  itea). 


Feedback  o^  this  type  generally  presents 
cuaulative  infonation  after  a  learner  has 
answered  a  set  mnber  of  iteis  correctly  or 
incorrectly  (e.g.,  "Good  you  gotten  6  itens 
correct. "} 
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Towards  a  theoiy  of  instructional  text  design 

Alistair  Stewart,  Dundee  College  of  Technology,  Scotland 
Introduction 

Perhaps  it  is  because  text  is  such  a  ubiquitous  part  of  the  teaching/learning  environment  that 
those  who  use  it  for  instruction  appear  to  do  so  without  any  consideration  for  its  design  to 
facilitate  learning.  Yet  it  cannot  be  assumed,  as  Cunningham  et  al  (1981)  have  pointed  out, 
that  meaning  lies  on  a  page  and  must  somehow  be  lifted  from  the  page  into  the  mind  of  the 
reader.  It  is  clear,  rather,  that  the  way  text  is  comprehended  and  remembered  is  a  function  of 
both  the  structure  of  the  text  and  the  knowledge  utilised  by  the  individual  (Voss  &  Bisanz, 
1985).  In  approaching  the  design  of  text  as  an  instructional  medium,  therefore,  the 
instructional  designer  or  instructional  materials  developer  has  to  have  a  clear  understanding 
of  the  process  of  reading  comprehension  and  the  variables  in  both  the  reader  and  the  text 
which  can  affect  that  process  (Stewart,  1987). 

Reading  comprehension  is  an  interactive  process  between  text-based  ideas  and  reader-based 
schemata  where  the  greater  the  correspondence  between  the  text  and  the  prior  knowledge  of 
the  reader  the  more  efficient  will  be  the  comprehension  (Stewart,  1986).  Individual 
differences  in  reading  performance  can  arise  from  factors  in  bottom-up  (or  text-based) 
processing,  top-down  (or  knowledge-based)  processing,  the  interaction  of  top-down  and 
bottom-up  processing,  and  the  metacpgnitive  control  processes  that  manage  the  entire  system 
(Spiro  &  Myers,  1984)..  Purpose,  worid  knowledge,  cognitive  and  metacognitve  skills,  and 
imagery  ability  have  b-^en  identified  as  some  of  the  inherent  characteristics  of  the  reader 
which  have  to  be  taken  into  consideration  by  the  instructional  designer  or  instructional 
materials  developer  (Stewart,  1986),  although  they  cannot  be  controlled  by  the  designer. 
Control  can,  however,  be  exerted  over  design  aspects  of  the  text  such  that  they  can  be 
manipulated  within  a  framework  of  identified  principles  in  order  to  facilitate  comprehension. 
Understanding  of  these  principles  should  enable  the  instructional  designer/developer  either  to 
work  from  first  principles  to  develop  acceptable  practice  or  to  examine  current  practice 
against  the  criteria  c:  identified  principles  and  a  theory  of  instructional  text  design  to  which 
they  contribute. 


The  bases  for  a  theory 

There  is,  at  present,  no  single  theory  of  learning  from  text  which  would  enable  the  outiining 
of  a  theory  of  instructional  text  design.  What  exists  is  a  number  of  theories  relating  to  how 
people  learn  from  text,  the  most  fundamental  of  which  are  those  emanating  from  cognitive 
psychology  regarding  the  interactive  nature  of  tiie  reading  process  and  the  structured  and 
organised  nature  of  knowledge  in  memory.  These,  of  themselves,  do  not  constitute  a  theory  of 
instructional  text  design  but  they  do  provide  a  focus  on  which  such  a  theory  can  be  built. 
Stewart  (1986)  has  identified  areas  of  design  concern  -  legibility  &  readability,  visual 
illustration,  and  structure  &  organisation  -  and  has  derived  principles  in  relation  to  these 
areas,  with  particular  relevance  to  the  cognitive  psychology  theories  mentioned  above,  in  an 
attempt  to  determine  ways  in  which  there  could  be  a  contribution  to  the  structured  and 
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organised  nature  of  knowledge  acquisition  within  a  framework  of  the  interactive  nature  of  the 
reading  process.  Each  area  of  design  concern  was  considered  as  contributing  either  to  the 
'interactivity'  of  the  process  or  to  the  structure  &  organisation  aspect  of  acquired  knowledge 
in  memory.  A  unifying  theory  can  be  developed  from  these  considerations  in  which  it  is  clear 
that,  since,  (a)  reading  is  an  interactive  process  between  reader  and  text,  (b)  the  process  is 
contributed  to  by  chciracteristics  of  both  the  text  and  the  reader,  and  (c)  knowledge  in 
memory  is  highly  smictured  and  organised,  design  elements  of  the  text  can  be  manipulated  to 
ensure  that  existing  knowledge  in  the  reader  can  be  activated  so  that  new  knowledge 
presented  in  the  text  in  a  structured  and  organised  way  and  appropriately  highlighted  through 
verba!  and  ^|^graphic  cueing  supported,  as  required,  by  visual  illustration  and  organisation 
can  be  assimilated  in  a  manner  facilitative  of  comprehension. 

Before  outlining  the  nature  of  the  emerging  theory  it  is  appropriate  to  consider  the 
contribution  to  that  theory  from  the  identified  areas  of  dissign  concern. 

Structure  &.  organization 

Wvaat  (1985)  has  noted  that  information  in  permanent  memory  if  highly  organised  and  can 
be  pictured  as- a  complex  network  or  a  hierarchical  array,  with  three  basic  forms  of  inform- 
ation being  theorised  -  concepts,  propositions,  and  schema.  Not  only  are  the  forms  of 
information  organised;  they  achieve  meaning  by  their  relationships  to  one  another.  Brandt 
(1978)  has  argued  that  the  content  and  structure  of  passages  of  text  are  inextricably  linked 
and  that  students  will  learn  better  from  text  if  they  can  follow  the  organisation  of  the 
material  and  later  use  that  organisation.  Glynn  &  Britton  (1984)  have  suggested  that,  since 
comprehension  of  text  can  be  a  cognitively  demanding  task,  authors  can  help  readers  to 
comprehend  and  iccall  text  information  by  making  sure  that  the  design  of  their  text  supports 
each  of  the  component  comprehension  processes  that  the  readers  must  perform,  including, 
inter  alia,  identifying  the  important  ideas  in  the  text,  organising  those  ideas,  and  integrating 
them  with  prior  knowledge. 

Armbruster  &  Anderson  (1985)  found  that,  before  text  organisation  became  clear  to  them,  it 
was  necessary  to  analyse  the  underlying  organisation  of  the  content  of  the  material.  This 
emphasis  on  content  analysis  should  hardly  be  surprising  for  the  designer  of  instructional  text 
since  a  prerequisite  to  the  design  of  instructional  materials  must  necessarily  be  a  task  or  topic 
analysis.  What  is  needed  is,  in  essence,  an  analysis  of  a  topic  to  fmd  the  logical  heirarchical 
relations  in  the  topic  so  that  instruction  can  be  sequenced  accordingly  (Tiemann  &  Markle, 
1985).  The  Hrst  step  within  the  structure  &  organisation  virea  of  design  concern  must, 
therefore,  be  the  carrying  out  of  a  topic  analysis. 

Such  a  topic  analysis  not  only  clarities  the  hierarchic  relationships  within  the  topic,  but 
provides  tiie  basis  for  identifying  the  desired  learning  outcomes  or  objectives.  Glynn  et  al 
(1985)  have  indicated  that  the  organisation  of  text  can  be  made  explicit  through  both  verbal 
and  typographical  cueing  systems.  It  has  been  postulated  by  Stewart  (1986)  that  the  state- 
ment of  a  high-level  learning  outcome  as  an  objective  in  advance  of  reading  will  lead  the 
reader  to  adopt  a  "deep  approach"  (Dahlgren,  1984)  to  the  reading  of  the  passage.  Since 
such  ah  outcome  can  also  be.  achieved  by  the  insertion  in  text  of  higher-level  questions,  it  is 
suggested  that,  in  practice  the  high-level  learning  outcome  can  be  stated  in  advance  of  the 
passage  of  text  and  high-level  questions  related  to  the  stated  learning  outcome  can  be 
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included  within  the  text.  Thus,  the  clarification  of  learning  outcomes  or  objectives  enables 
the  instructional  designer/developer  to  decide  what  kind  of  verbal  cueing  or  pre-instructional 
strategy  can  be  used  to  help  the  reader  to  recognise  the  desired  outcome  and  adopt  an 
appropriate  approach  to  the  reading  task.  It  also  allows  the  designer  to  give  consideration  to 
the  formulation  of  the  in-text  questions  of  an  appropriate  type  and  level. 

Hie  topic  analysis  exercise,  in  clarifying  the  hierarchic  relationship,  enables  the  instructional 
designer  or  instructionai  materials  developer  also  to  consider  the  kind  of  verbal  cueing 
necessary  in  relation  to  any  advance  organizer  which  must  reflect  the  structure  &  organisation 
of  tiie  text  and  alert  the  reader  to  relevant  schema-activation.  Stewart  (1986)  has  suggested 
the  principle  that,  if  the  reader  is  oriented  by  a  brief  verbal  organizer  toward  the  application 
of  existing  knowledge  to  the  assimilation  of  the  main  features  of  new  knowledge  in  text, 
comprehension  of  that  new  knowledge  will  be  facilitated.  Application  of  this  principle 
requires  an  emphasis  on  the  activation  of  existing  knowledge  which  is  really  guidance  to  the 
reader  and  is  an  extension  or  broadening  of  the  concept  of  advance  organizer. 

The  verbal  cueing  arising  ft'om  the  topic  analysis  thus  allows  an  integration  of  learning 
outcome  and  overview  of  structure  together  with  schema  activation  and  establishment  of  a 
deep-approach  set  to  learn. 

Clarification  of  the  hierarchic  relationship  provides,  additionally,  the  basis  for  the 
determination  of  the  structure  of  the  text  and  from  that  can  be  developed  the  verbal  and 
t^rpographical  cueing  necessary  to  make  explicit  the  structure.  It  is  clear  from  the  work  of 
Singer  (1985)  and  Meyer  (1981,  1985)  that  there  are  organisational  features  of  text  which,  if 
recognised  and  used  by  students,  can  lead  to  better  process  and  recall  of  information,  and 
Stewart  (1986)  proposed  a  principle  of  textual  structure  &  organisation  which  deduced  that,  if 
the  critical  information  to  be  communicated  is  appropriately  emphasised  as  part  of  an  overall 
text  structure,  comprehension  will  be  facilitated.  Application  of  this  principle,  while  being 
ostensibly  linguistic  or  psycholinguistic  in  nature,  has  implications  for  instructional  design,  in 
that  instructional  designers  or  instructional  materials  developers  need  to  be  concerned  with 
linguistic  factors,  a  skill  not  necessarily  expected  to  be  part  of  the  instructional  design 
armoury. 

Li  analysing  the  research  on  typographical  cueing,  Stewart  (1986)  was  able  to  suggest  the 
principle  that,  if  headings  in  text  are  chosen  and  arranged  spatially  and  typographically  to 
reflect  the  structural  relationships  in  the  text,  comprehension  of  both  the  structure  and  the 
content  of  the  text  is  likely  to  be  enhanced.  It  is  not  often  in  an  instructional  text  that  the 
headings  are  arranged  either  spatially  or  typographically  to  reflect  the  structural  relationship 
of  ideas  in  the  text.   What  is  needed  in  practice  is  a  greater  correspondence  betweeen  the 
conceptual  map  and  the  typographical  organisation  of  headings,  a  bringing  together  of  notions 
of  verbal  and  visual  cueing  allied  with  typography  to  help  the  reader  comprehend  both  the 
structure  and  the  content  of  the  text,  llie  stalling  point  is  the  topic  analysis:  the  end  is  a 
contribution  not  only  to  comp.ehension  but  to  legibility,  layout  and  readability. 

Several  areas  of  design  concern  are  clearly  brought  together  through  consideration  of  the 
topic  analysis  as  can  be  seen  in  the  following  illustration. 
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It  should  be  noted,  additionally,  that  consideration  of  structure  and  organisation  issues  also 
raises  the  questions  of  whether  graphic  organizers  should  be  used  and  whether  encouragement 
to  the  reader  to  utilise  imagery  abilities  is  appropriate.  Two  principles  enunciated  by  Stewart 
(1986)  are  relevant. 


"If  a  graphic  organizer  is  used  to  convey  isomorphically  the  structure  of 
ideas  in  text,  then  comprehension  of  the  structure  will  be  facilitated". 

**If  the  content  of  the  text  is  related  to  spatial,  creative,  or 
problem-solving  applications,  the  eliciting  of  imagery  processes  in  its 
comprehension  will  be  helpful". 


Yisml  illustration 

The  second  area  of  design  concern  which  the  instructional  designer  or  instructional  materials 
developer  needs  to  consider  is  that  of  visual  illustration.  The  observation  by  Perkins  (1980) 
that  practical  picture  making  is  a  matter  of  recipe  rather  that  principle  is,  unfortunately,  too 
often  correct  in  education.  The  basic  misunderstanding  of  the  use  of  visuals  in  learning 
probably  lies  in  a  belief  that  the  message  is  in  the  visual.  It  has  to  be  recognised  that  the 
message  is  not  in  the  visual  alone:  the  message  is  constn    "d  in  an  interaction  between  the 
visual  stimuli  and  the  prior  knowledge  etc  of  the  viewer   in  education,  too  great  an  emphasis 
has  been  placed  on  the  role  of  the  visual  and  too  little  on  the  internal  processing  of  the 
viewer  (Winn,  1982;  Salomon,  1979). 

Duchastel's  (1978,  1981)  notion  of  attentional,  explicative,  and  retentional  functions  of 
illustration  appears  to  be  well  founded  in  the  available  theories  of  cognitive  and  visual 
processing  systems,  and  is  consistent  with  tiiose  of  Levin  (1979,  1981)  and  Levie  &  Lentz 
(1982).  The  idea  that  illustrations  attract  attention  to  materials  is,  intuitively,  acceptable, 
although  it  would  be  more  persuasive  if  it  established  that  illustrations  were  the  initial  focus 
of  attention.  There  is  a  real  sense  in  which  the  text  as  a  whole  can  either  attract  or  repel,  a 
feature  which  is  related  to  congeniality,  and  it  is  very  likely  that  illustrations  play  an 


important  role  in  this  respect.  Great  use  is  made  of  explicative  illustrations  in  instructional 
texts,  teaching  directly,  explaining  and  clarifying,  but  the  retentional  role  of  illustrations  tends 
not  to  be  so  widely  considered,  yet,  as  Duchastel  (1981)  has  pointed  out,  any  topic  or  domain 
of  discourse  has  an  internal  structure  which  can  be  exploited  in  visual  terms  for  the  purpose 
of  recall. 

The  instructional  designer  needs  to  be  clear  -^bout  the  function  to  be  performed  by  the 
illustration.  Duchastel's  (1980)  reminder  that  it  is  the  type  of  illustration  and  its  relationship 
with  the  verbal  component  of  the  text  which  will  make  it  useful  or  not,  is  a  crucial 
consideration. 

After  reviewing  the  available  research  on  visual  illustration  in  text,  Stewart  (1986)  proposed 
the  following  principles. 

"If  illustrations  are  developed  as  an  intergral  part  of  the  text  design 
they  will  perform  a  motivational  or  attention-getting  function". 

"If  illustrations  are  designed  to  support  organisatipnal  or  conceptual 
aspects  of  a  topic  in  text,  they  will  facilitate  comprehension**. 

"If  illustrations  are  developed  to  support  the  verbal  argument  of  text, 
the  integrity  of  the  text  will  be  enhfiuiced  if  the  illustrations  are 
appropriately  embedded,  and  alluded  to,  in  the  text". 

Implementation  of  these  principles  requires  the  in.^ctional  developer  to  integrate  text  and 
visual  development  and  to  justify  to  printers  or,  publishers  why  particular  visual  images  not 
only  need  to  be  presented  in  a  specified  way  but  be  included  adjacent  to  identified  parts  of 
text.  The  relationship  between  words  and  pictures  within  the  context  of  the  structure  & 
organisation  of  the  text  is  what  is  at  issue  and  the  use  of  visuals  in  text  cannot,  therefore,  be 
left  to  the  discretion  of  editors,  illustrators,  or  anyone  other  than  the  person  with  overall 
control  of  the  text  design  process. 

Readability,  legibility  and  tayout 

Having  given  consideration  to  the  stnicture  and  organisation  aspects,  together  with  the  aspects 
associated  with  visual  illustration,  the  instructional  designer  or  instructional  developer  has  to 
prepare  the  textual  material,  taking  into  consideration  not  only  those  linguistic  aspects  of  text 
which  enable  idea  units  to  be  highlighted  within  the  overall  indication  o.f  structure,  but  the 
linguistic  aspects  which  influence  the  affective  and  cognitive  dimensions  of  readability. 

Despite  the  widespread  criticism  associated  with  readability  research  due,  almost  entirely,  to 
the  misuse  of  and  extravagant  claims  for  readability  indices,  readability  remains  an  important 
issue  in  the  design  of  instructional  text.  From  an  analysis  of  research  in  the  area  of 
readability,  Stewart  (1986)  has  highlighted  the  relationship  between  readability  and 
motivation,  claiming  tiiat  initial  motivation  can  be  heightened  through  the  design  of  text 
which  is,  in  an  affective  sense,  'readable',  and  that  readability  will,  in  turn,  be  improved 
because  of  the  increased  motivation.  Considerable  attent'.on  needs  to  be  directed,  therefore, 
to  those  aspects  of  the  text  >vhich  contribute  to  its  affective  dimension,  such  as  typestyle  and 
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layout.  The  affective  aspect  of  readability  caii,  potentially,  induce  emotional  and  motivational 
factors  which  are  crucial  to  the  arousing  of  interest  and  tiie  focusing  of  attention  which,  in 
turn,  are  prerequisite  to  the  facilitation  of  comprehension* 

There  is,  too,  a  cognitive  dimension  to  readab:!!ty.    A  cognitive  psychology  framework  for  an 
understanding  of  the  comprehension  process  and,  thus,  for  readability,  emphasises  the 
psycholinguistic  aspects  of  text  as  well  as  the  reader-based  sources  of  variance  (Huckin, 
1983;  Chall,  1984)-  Stewart  (1986)  has  suggested  two  principles  of  readability,  viz 

**If  the  semantic  and  syntactic  structure  of  the  text  is  matched  to  the 
vocabulary  and  reading  ability  of  the  reader,  there  is  more  likely  to  be 
meaningful  interaction  between  reader  and  text". 

^'If  the  content  and  the  psycholinguistic  organisation  of  a  text  are  related 
to  the  prior  knowledge  and  cognitive  ability  of  the  reader,  the  readability 
of  the  text  will  be  enhanced". 

These  two  principles  raise  problems  for  educational  practice  due  to  the  connection  of  content 
and  style  with  reader  ability  and  prior  knowledge.  Print  is  essentially  a  masG  medium,  yet 
these  principles  demand  a  considerable  measure  of  individualisation.  The  application  of  these 
principles  is  probably  best  carried  out  by  careful  consideration  of  the  group  of  readers  for 
whom  the  material  is  being  prepared,  assessing  as  accurately  as  possible  the  abilities  and 
prior  knowledge  which  they  have. 

The  designer/developer  has  to  ensure,  therefore,  that  the  adopted  style  and  the  overall 
appearance  of  the  material  arising  from  the  readability  and  layout  considerations  arc 
conducive  to  the  cultivation  of  motivation  and,  thus,  comprehension. 

Specific  clteria  of  legibility  becomes  the  final  check  with  respect  to  physical  parameters  of 
the  text  l^J  ensure  that  in  tiie  denoting  of  structure  the  t'^ppgraphical  cueing  is  consistent  with 
the  other  aspects  of  typography  which,  together,  contribui^  to  a  well  designed  text. 

Principles  of  legibility  identified  by  Stewart  (1986)  and  derived  in  relation  to  typeface, 
typestyle,  size  of  type,  length  of  line  and  interlinear  spacing,  and  justification,  arise  primarily 
from  text-based  parameters  and  are  affected  only  marginally  by  tfie  input  of  the  reader. 
However,  although  the  use  of  typographical  characteristics  to  affect  layout  is  determined,  in 
part,  by  physical  parameters,  there  is  also  a  potential  contribution  in  respect  of  their  cueing 
capacity  Relevant  principles  identitied  by  Stewart  (1986)  are: 

**If  the  layout  of  a  p?ge  is  determined  by  the  empirical  evidence  regard- 
ing typographic  characteristics,  the  page  will  be  more  legible  than  if 
these  characteristics  are  ignored'-. 

**If  the  typographic  arrangement  reflects  the  key  features  of  the  content 
of  the  text,  comprehension  of  the  structure  of  tfie  text  will  be  facil- 
itated". 

Since  it  is  unreasonable  to  expect  typesetters  or  printers  to  be  able  to  analyse  content  and 
indentify  J'ey  features,  typographical  cueing  needs  to  be  determined  by  the  author  or  designer 
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of  the  instructional  text,  so  it  is  important  ihH  such  persons  be  familiar  with  typography  and 
its  manner  of  specification* 

The  emerging  theory 

Frcm  the  discussion  above,  it  is  clear  that  the  emerging  theory  of  instructional  text  design 
involves: 

(a)  a  topic  analysis  to  determine  the  hierarchic  relationship  of  ideas  within  the  topic  and  the 
desired  learning  outcomes  or  objectives,  from  which  can  be  determined 

(i)  the  kind  of  verbal  cueing  or  pre-instructional  strategy  necessary  to  enable  the  reader 
to  recognise  the  desired  outcome  and  adopt  an  appropriate  approach  to  the  reading 
task; 

(ii)  the  kind  of  verbal  cueing,  reflective  of  the  smicture  and  organisation  of  the  text, 
necessary  for  relevant  schema  activation; 

(iii)  the  basis  for  the  structure  of  the  text  and,  thus,  the  typographical  cueing  necessary 
to  make  the  structure  explicit;  and 

(iv)  the  kind  of  questions  which  can  be  inserted  in  the  text; 

(b)  a  consideration  of  the  linguistic  aspects  of  text  which 

(i)  enable  idea  units  to  be  highlighted  within  the  overall  indication  of  structiire; 

(ii)  influence  the  affective  and  cognitive  dimensions  of  readability; 

(c)  a  consideration  of  the  role  of  visual  illustrations  as  to  whether  they  are 

(i)  motivational,  explicative,  or  retentional  in  intent; 

(ii)  indicative  of  spatial  relationships  in  the  text;  and 

(d)  a  consideration  of  the  physical  parameters  of  the  text  to  ensure  that,  in  the  denoting  of 
structure,  the  typographical  cueing  is  consistent  with  the  other  aspects  of  typography. 

Although  not  particularly  important,  it  can  be  noted  that  the  issues  (a)-(d)  are,  respectively, 
the  design  areas  of  structure  &  organisation,  readability,  visual  illustration,  and  legibility,  tiie 
resulting  acronym  for  which  -  SORVIL  -  might  usefully  identify  this  approach  to  a  theory  of 
instructional  text  design. 

It  is  not  claimed  that  this  is  a  complete  theory  of  instructional  text  design,  but  it  is  offered  as 
a  contribution  to  such  a  theory.  There  could  be  other  inter-relationships  between  the 
identiHed  areas  of  design  concern  which  need  to  be  explored  and  there  may  well  be  other 
design  areas  which  need  to  be  taken  into  consideration. 

The  instructional  designer/developer,  in  approaching  the  design  of  text,  would  nomially 
develop  the  material  in  accordance  with  accepted  instructional  design  procedures  consistent 
widi,  for  example,  an  educational  technology  approach  to  the  design  of  instruction.  However, 
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as  Stewart  (1985)  has  alleged,  the  principles  of  educational  technology  are  not  always  explicit 
and  there  is  a  tendency  for  instructional  designers  or  instructional  media  developers  to  adopt 
established  procedures  and  practices  without,  necessarily,  being  able  to  justify  these  practices 
from  more  fundamental  priiiciples  of  educational  technology*  It  is  therefore  likely  that,  in  the 
development  of  instructional  text,  the  same  approach  is  being  adopted* 

In  moving  towards  a  theory  of  instructional  text  design  which  is  based  firmly  on  valid 
principles,  it  is  hoped  that  instructional  designers  and  instructional  materials  developers  will, 
in  the  application  of  that  theory,  measure  practice  against  principle  and  allow  principle  to 
determine  practice. 

As  Carter  (1985)  has  observed, 

**.  .  .  the  problem  of  producing  usable  written  materials  may 
have  less  to  do  with  discovering  a  host  of  nev  principles  than 
with  learning  to  routinely  apply  these  we  already  know**.  (pi56) 
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Instructional  Design  for  the  Inproveanent 

of  Learning  and  CJognition 

Ihe  purpose  of  this  paper  is  to  present  a  oognitive-scienoe  based 
instructional  planning  and  design  model  that  deals  directly  with  the 
educational  goals  of  both  kncwledge  acquisition  (i.e.,  3 earning)  and  eoplqyment 
(i.e. ,  cognition) .   Ihe  model  describes  the  direct  relationship  between 
specLSixi  oognitivB^jased  objectives  and  instructional  methods.   Within  this 
context,  we  follow  Gagne's  (1985)  premise  that  unique  instructional  methods 
directly  iaprove  specific  learning  and  thinking  processes.   Thus,  we  propose  an 
instructions?  planning  and  design  model  by  which  to  llric  cognitive  processes 
and  ctojectiyes  to  pacific  instructional  methods.   An  additional  feature  of 
cur  planning  and  design  model  is  the  direct  reference  to  instructional  time 
allocations  for  each  cognitive^sased  objective  (see  Figure  1) . 

instructional  Planning  and  Design  Model 

Hi  this  paper  we  present  a  basic  model  for  planning  the  learning 
enviromient  that  proposes  application  of  cognitive  learning  theory  wititi 
sgecitic  inctructional  methods  (Figure  1) .   m  other  sources  are  presented  the 
enpirical  findings  that  support  the  instructional  methods  in  terms  of  their 
affect  in  inpcoving  learning  and  cognition  (for  a  review  of  the  ertpirical 
findings  see  Tennyson  &  Breuer,  1984;  Tenryson  &  Coochirella,  1986;  Itennyson, 
Ifeurlcw,  &  Breuer,  1988) .   Ou,v  purpose  in  this  paper  ia  to  prcpoee  an 
instructional  design  model  that  focuses  on  the  planning  of  a  learning 
environment  so  that  students  not  only  aoqoire  knowledge  but  also  inprove  their 
cognitive  abilities  to  eaploy  and  extend  their  knowledge. 


Insert  Figure  1  about  here 


Educational  leaders  have  rece^itly  renewed  their  call  for  planning  of 
learning  envircpnents  that  ejdiibit,  in  addition  to  acquisition  of  information 
(or  content) ,  tiie  learning  of  hi^ier^rder  thinking  strategies  (e.g. ,  Savell, 
IVJohig,  i  Racaiford,  1986)  and  the  development  cognitive  abilities.  Hbwever, 
two  major  problems  persist  in  the  implementing  of  such  goals.     Die  first  is 
the  ocntlnulng  assumption  that  a^ipropriate  Instructional  methods  are  not 
available.  And,  second,  that  improvement  in  cognition  occurs  throu^  scmL 
independent  system  external  to  the  mainstream  curricular  programs.  R>r 
example,  tiiat  thinking  skills  can  be  acquired  through  'jhe  practice  of  generic 
strategies  and  then  latter  transferred  across  any  dcmain  of  information  (i.e. , 
Feuerstein,  Rawl,  Hofftaan,  &  Miller,  1980) .  However,  our  thesis  here  is  that 
both  problems  can  be  solved. 

First,  educational  research  in  the  past  two  decades  has  investigated 
Instructional  variables  and  conditions  that  shew  dramatic  improvements  in  both 
knowledge  acquisition  and  eoployment  (Reiser,  1987) .   Thus,  it  is  possible  to 
define  In  concrete  terms  instructional  methods  that  can  improve  both  cognitive 
goals. 
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Second,  research  f  inalngs  strongly  indicate  that  higher-order  thinking 
strategies  are  best  learned  within  the  context  of  conventional  subject  matters 
(Resnick,  1981).  lhat  is,  penaoeas  with  guide-study,  (kacdn-'independent 
methods  do  not  Faxndde  the  conoG|ytual  knowledge  necessary  to  iiifscove 
accessibility  of  infooution  in  the  knowledge  base.  Althou^  research 
continues  on  instructional  variables  and  strategies,  there  are  currently 
available  instructional  lusUxsds  that  can  ianediately  meet  the  educational 
goals  of  Ijoproving  both  knowledge  acguiritiai  and  enplovment  (Gagne,  1987) . 

A  key  factor  in  in|»laaBnting  the  cognitive  goals  of  knowledge  acquisition 
and  enplopaent  is  the  allocation  of  learning  tiane  with  instructional  methods 
within  a  cnrriojlar  context  (See  Kalik  &  Rillk,  1984,  for  a  i-^fiew  on 
performance  and  instructional  time) .   For  exanple,  Goodlad  (1984)  suggested, 
ficom  his  research  findings  on  cOassrocni  time  and  instructional  activities, 
that  a  significant  change  in  instructional  time  allocated  to  various  learning 
activities  most  be  done  if  inprovements  in  problem  solving  and  cxBativity  jece 
to  occur.   He  reconnended  that  the  conventional  instructional  time  allocation 
for  learning  be  altered  so  that,  instead  of  70%  of  instruction  be  aimed  at  the 
decOarative  and  procedural  knowledge  levels  of  l£:^ming,  70%  be  devoted  to 
learning  and  thirfdng  situations  that  involve  acquisition  of  conceptual 
knowledge  and  development  of  cognitive  abilities.  And,  that  these 
instructional  situations  be  done  within  the  subject  matter  areas,  not  external 
to  then. 

Using  Goodlad's  reconnended  figures  on  instructional  time  allocation,  we 
propose  that  70%  of  formal,  classroom  learning  time  use  instructional  methods 
thac  focus  on  higher^srder  learning  aiid  cognition,   m  Figure  1,  we  present  an 
instructional  planning  model  of  the  learning  environment  that  shows  the  direct 
relationshj^  between  learning  time,  cognitive  objectives,  memory  s'.'stans 
ocqponents,  and  instructional,  strategies.   Figure  1  shows  a  time  allocation 
guideline  for  currxculm  planning  such  that  the  goals  of  knowledge  acquisition 
and  ex^lqyment  can  be  traced  between  cognitive  objectives  and  specify 
instructional  methods. 

Memory  Systems 

Ihe  acquisition  of  information  and  the  means  to  aoploy  information  occurs 
within  the  storage  and  retrieval  subsystems  of  the  long-term- manory  ccnponent 
(Tennyson  &  Breuer,  1984) .   ihe  storage  system  is  where  coded  information  is 
assimilated  into  the  existing  knowledge  base.  A  knowledge  base  can  be 
described  as  an  associative  network  of  conc^jts  (or  schemas)  varying  per 
indivixJual  according  to  amount,  organization,  and  accessibility  of  its 
information  (Rabinowitz  &  Glaser,  1985) :  amount  refers  to  the  actual  volume  of 
information  coded  in  memory,  vtoile  organization  iaplies  the  structural 
connections  of  that  information,        accessibility  referring  to  the  executive 
control  strategies  iised  in  the  service  of  thinkincr  (i.e.,  recall,  problem 
solving,  and  creativity) .  Ohe  latter  two  forms  of  knowledge  are  ^hosc.  that 
separate  an  expert  from  the  novice.  Ihat  is,  a  large  amount  of  Information  is 
not  the  key  to  expert  thinking,  but  rather  the  ability  to  both  find  and  enp'.qy 
information  z^pxipriately. 

Within  storage  there  are  var^       'Drms  of  knowledge:  declarative, 
procedural,  and  crnoaptual  (Shif frii*  *  Dumais,  1981) .  Each  form  r^jresents  a 
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different  maaty  system  or  function.   Declarative  knowledge  daplies  an 
aMtteness  of  infooation  and  refers  to  the  "taowlng  that,"  for  exancle,  that 
underlining  loeywacds  in  a  text  will  help  recall.   Procedural  knowledge  iijplies 
a  "knowing  hew"  to  use  given  ocnoepts,  rules,  and  principles.  Onxptual 
toCTTledge  iafilies  an  undterstaiSiing  of  "knowing  «hen  and  why"  to  select  specific 
ccnoepts,  rules,  and  prlixdples.  Ihis  executive  ocntrd  process  of  knowLw 
vftien  and  why,  is  governed  by  selection  criterii:^  enfceddad  within  the 
organizatiai  of  the  knowledge  base.   Criteria  are  the  values  and  situational 
aFpropriatsness  by  which  connections  within  the  schenatic  structure  of  a 
knowledga  base  are  made,  ftwreas  both  declarative  and  procedural  knowledge 
form  the  amount  of  infbnaation  in  a  knowledge  base,  conceptual  knowledge  foms 
its  organization  and  accessibility. 

Ihe  retrieval  system  enplcys  the  cognitive  abilities  of  differentiation 
(i.e.,  selection)  and  integration  (i.e.,  restructuring)  In  the  service  of 
thlrfdng  strategies  associated  with  recall,  problem  solving,  and  creativity. 
Recall  strategies  eaploy  only  the  automatic  selection  (i.e.,  differentiation) 
of  knowledge  directly  as  stored  In  jiemory.  Problem  solving  strategies,  on  the 
other  hand,  require  both  cognitive  abilities  of  differentiation  and  integration 
and  are  farmed  at  the  time  of  solution  and  stored  as  nmvtgH  ii^i  knowledge, 
lhat  is,  problem  solving  strategies  are  domain  specific  and  cannot  be 
considered  as  generic  "skills"  that  can  be  transferred  between  demains. 
Ihsrefore,  the  ammilation  of  prcblem  solving  strategies  in  the  knowledge 
base  occurs  in  diroct  reference  to  nunber  of  problens  solved  within  given 
domains.   Creativity  strategies,  in  addition  to  enploying  differentiation  and 
integration,  make  use  of  the  cognitive  ability  to  create  knowledge  not  alreachr 
coded  in  menoiry  (Dehen  &  Schanik,  1982) . 

In  suonary,  all  three  kinds  of  thitddng  strategies  are  acgalzed  while 
using  the  cognitive  abilities  of  differentiation.  Integration,  and  creatic  i. 
Each  strategy  farm  is  entoedded  by  domain  within  the  conceptual  knowledge 
structure  of  the  knowledge  base.  Therefore,  as  the  learner  engages  in  more 
thiriking  situations,  the  individual  strategies  beccne  increasingly  more 
abstract  and  generalizable  within  the  domain  (Stcrriberg,  1S85) . 

Oocmitive  Qaapledtv. 

As  stated  above,  thlhklng  strategies  eoploy  the  three  cognitive  abilities 
of  differentiation,  integration,  and  creation  of  knowledge.   !lhe  fi^t  two 
abilities  occur  primarily  in  the  retrieval  system  of  memory  while  the  third 
further  involves  the  other  conponents  of  the  entire  oomitive  system  ^see 
Figure  1) .  ^  jr  v 

Bie  operational  term  for  the  retrieval  system  functions  of  differentiation 
and  integration  is  oocmitive  ccnpl^^ity  (Schroder,  1971) .  cognitive 
ocnplexity,  as  contrasted  to  intelligenoe,  is  an  ability  that  can  be  de'/eloped 
and  Ixproved  (Strsufert  &  Swezey,  1986) .   Differentiation  is  (>3flned  as 
follows:  (a)  the  jbility  to  xxnderstand  a  given  situation;  and  (b)  the  ability 
to  ^y  appropriate  conceptual  criteria  (i.e.,  the  standards,  situational 
{^propriateness,  anVor  values)  by  which  to  select  necessary  knowledge  fixm 
storage,   integration  is  the  ability  to  elaborate  or  restructure  existing 
knowledge  In  the  senlce  of  the  given  problem  situation.   Creativity  is  the 
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ability  to  fam  new  declarative  and  procsedural  knowiledge  as  well  as  ccno^^ual 
loxwledge  by  iising  the  total  cognitive  system. 

learning  Time 

Ohs  allocation  of  learning  tiine  is  divided  between  the  tuo  main  subsystems 
of  Icng-tiuB  nenooy— storage  anl  retrieval.   Within  the  guidelines  illiistrated 
in  Figucft  1,  time  is  assigned  aoccseding  to  the  BMoory  s^tAxm  defined  in  the 
poNixxm  sectixn.   m  the  storage  aystan,  learning  tine  is  allocated  among  the 
three  sMury  systcns  oaking  vp  a  ymaOMSg^  base  as  followB:  declarative 
kncvledge  10%;  prooedare  )attwledge  20%;  and  conceptual  toxwledge  25%.  ite  are 
reocnoinding  that  connptual  loxwledge  learning  tim  be  about  eqpial  to  the 
other  two  loiowledge  fomns  because  of  the  necessity  in  aoqioiring  infongntion  to 
both  ocgeoiize  a  kncwledge  base  and  develop  aooMsibility.  Ohe  value  of  a 
jcncwledge  base  is  pdaarily  in  the  functionality  of  its  organisation  and 
acoassibility.  Without  a  sufficimt  base  of  conceptual  knowledge,  the 
opportunity  for  eniaoynant,  fixture  elaboration,  and  exteraion  of  the  knodedge 
base  is  severely  limit 't  (for  exanple,  see  Bransfoni  &  Johnson,  1972;  Brown, 
1978;  Dobwer,  1975). 

For  the  knowledge  aoqaisition  goal,  the  focus  of  our  learning  tiiae 
allocation  is  on  conceptual  knowled^n,  and  away  from  the  \3sual  practice  of 
heavy  Miphasis  on  amount  of  infomation.  We  are  assuming  that  content 
knowledge  aojaisition  is  an  interactive  process  that  is  iaproved  «hen  enploying 
the  knowledge  base  in  the  service  of  hig^ier^-order  thinking  situatiora  (i.e., 
problan  solving  and  creativity) .   Time  allocated  for  declarative  and  procedural 
knowledge  focuses  on  establiihing  an  initial  base  of  necessary  content 
knowledge  that  can  be  used  within  a  context  of  a  problcn  situation.  That  is, 
learning  tine  ehould  include  the  cBportunity  for  the  learner  to  gain  ei^jerienoe 
in  enployixig  tibe  knowledge. 

Ihe  learning  tines  prooontod  in  Figure  1  do  not  inply  a  linear  seouenoe 
of  knowledge  aoqaisition  going  from  declarative  to  conceptual.  Bather,"  they 
represent  total  amounts  in  an  iterative  learning  envixonnent  where  learners 
are  continuously  «ccpiirlng  each  form  of  knowledge.  For  exaarl«/  stud«r±3  may 
engage  in  conceptual  knowledge  aogoisition  prior  to  declarative  knowledge 
acquisition  if  they  oii-rently  hove  sufficient  background  knowledge  (i^e.,  a 
discovery  method  of  instruction  as  contrasted  to  a  stntctured  method) . 

OocBiitive-based  Otylectives 

Ihe  purpose  of  cognitiveH)ased  objectives  is  to  further  elaborate  the 
curricular  goals  of  knowledge  acguisiticn  and  eoploE^nent.   Objectives  are 
isportant  iri  the  plaming  of  leaniing  environnents  because  tiiey  provide  the 
means  of  both  allocating  leam'';g  tine  and  Identiiying  ^ncific  instructional 
methods.  Also,  isilike  behavioiral  objectives  viiidi  only  state  neasurable 
desired  end  of  instruction  outocnes,  oognltive4)ased  objectives  iiqply  a  g-lven 
cognitive  process  of  learning  or  thinking. 

m  terms  of  learner  asseseonent,  the  cogniUiveHaased  cbjectives  that  deal 
directly  with  the  aocpiisition  of  declarative  and  procedural  knowledge  (see 
Figure  1)  provide  for  quantitative  mea&ures  of  ^iecific  domain  information. 
However,  the  cognitive-based  objectives  for  oonc^Jtual  knowledge  acquisition 
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atki  iniiruvvuttits  in  thixddng  ars  anrs  subject  to  rsflactive  evalxiaticns  rattier 
than  thft  umal  cxarxect  or  inoorract  asaesaaents  aaaociated  with  tte  leaxnim 
of  ooRtflnb  infomatlon.    Ohat  is,  it  is  far  easiar  to  test  a  loxswledge  base 
for  aaasib  of  infomatiGn  than  it  is  to  aaasura  ths  organizaticn  and 
aooessibility. 

Ths  oognitivtt-baaed  Gfajec±ive8  prassnted  here  are  for  the  aost  part  taHoen 
fccn  Gagna's  (1985)  daasificatlon  of  learning  outoones.  Itwreas  Gagne 
preftea  to  Imp  all  tfclhlcinsr  prooeaaMi  into  cne  categpry  of  faunnn  capability 
(i.e.,  cognitive  strateglas),  %«  prefer  a  systaai  of  objectives  that  provixJes 
fbr  more  basic  distinctions  bebM  the  varioua  fdn»  of  thiriking.  This  allows 
for  ijqpaxyved  darification  of  both  inatructional  outooass  and  nethods.  Thus, 
there  is  a  direct  trace  bebMan  Macsy  systan  ooapoumta  and  objectives  and 
learning  tiae.  We  define  oognitiv»-based  objectives  as  fbUous: 

■Vtefcttl  infaaafciSP.  Ttdm  objective  deals  with  the  learner  aogoiring  an 
amnniss  and  understanding  of  the  compts,  rules,  and  principles  withLi 
a  apecified  doaain  of  Intonnation  (i.e.,  daclarative  Icnowledge) .  Ihe 
apecif ic  oonnpts  to  be  leanMd  is  idmtified  by  an  infbowtion  analysis 
procectoe  that  ahoMi  the  lidMBKtic  organization  of  the  doeain  as  weU  as 
the  individual  oonoapts.  An  analysis  of  ttm  infdnaation  to  be  learned 
is  a  highly  ^ji{»rtant  pcocedore  in  instructional  design  becauae  it 
providas  the  instructional  ae(|Mnof  >y  «hich  infocaation  can  be 
preeented.  That  is,  a  structured  setjiMnce  enhances  the  learner's 
initial  organization  of  a  loxwledge  baae  see  Tennyson,  1981,  for  a 
ooaplete  review  of  an  infomation  analysis) . 

"Blftlltgfafll  Bldilff.  Ohia  objective  invr^ves  the  learner  aoqoiring  the 
skill  to  correctly  use  the  ocnospts,  rules,  and  principles  of  a 
Bi?QcitiM  dcoain  of  infomnation  (i.e. ,  procedural  knowledge) .  Tar 
exanple,  the  classification  of  unenoountered  exaaples  of  a 
given  ocnoapt.   COiissification  is  the  intellectual  skill  by  which 
learners  to  both  discriminate  and  generalize  unencountctrad  eocanples.  ihe 
intellectual  skill  for  a  rule,  is  tim  ability  to  use  the  rule  correctly 
in  the  solving  of  an  unenoountered  pcobleai. 

-oonditicnal  infonnatlen.  ohis  objective  focueea  on  the  learner's 
aoqaisition  of  a  knowledge  base's  organization  and  accessibility  (i.e., 
conceptual  knowledge) .  Ohe  organization  of  a  knowledge  base  refers  to 
the  schenatic  structure  of  the  infomation  whereas  the  accessibility 
refers  to  the  executive  control  strategies  that  provide  the  neans 
necessary  to  eacOoy  the  knowledge  base  in  the  service  of  recall,  prcblem 
solving,  and  creativity.  Conceptual  knowledge  incaxxles  the  criteria, 
values,  and  aFpropriatenass  of  a  given  dcataim  schenatic  structure.  For 
exanple,  slnply  knowing  how  to  classify  exanples  or  knowing  how  to  use  a 
rule  (or  princiide)  does  not  iniay  that  the  learner  knows  when  and  i^l^  to 
enploy  specific  concepts  or  rules.  Therefore,  this  objective  defiz^  . 
leamir^r  environuBnt  where  the  learner  can  develop  both  the  associa.-ive 
network  of  the  knowledge  base  (i.e.  organization)  and  the  control 
strategies  to  effectively  enploy  the  knowledge  (i.e. ,  accessibility) . 

-m^^nHiyf  fftTTrtffTlw    Ihis  objective  deals  with  both  the  developn^  of 
cognitive  ccnpleadty  abilities  and  the  ixopcbvenent  of  dnnain  .iixcif  ic 
strategies  of  thiilking.   Ohus,  this  category  of  cognitive-based 
objectives  deals  with  two  iitportant  issues  in  education.  First,  the 
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elaboration  of  thinking  strategies  that  wiU  arm  the  stutents  with 
increased  djaain  specific  oono^Jtua}.  krvovledge.  As  stated  earlier, 
thinking  strategies  are  etanain-d^iden^  and  are  only  transferable 
between  dcnaiiis  at  the  moist  abstract  lev^  of  possible  enplojpent.  R>r 
exanple,  knowing  the  scientific  method  of  inqjiiry  does  not  in  and  of 
itself  pKJvide  sufficient  infoimatibn  to  trmisfer  across  disciplines 
without  the  furOier  acgiiisition  of  ionre  concrete  domainrdependent 
^plication  conoq)ts.   Second,  the  developnant  of  the  cognitive  abilities 
of  differ^itirtlon  and  Integratioh.  Ihese  abilities  provide  the 
oo^dtive  tools  to  effectively  enpicy  and  inprbve  the  knowledge  iase; 
therefore,  they  are.  integral  to  any  educational  goal  seeking  to  iaprove 
thinking  strategies. 

-Cpaativity.  This  objective  deals  directly  with  the  most  elxisive  goal  of 
educatiai,  and  that  is,  the  developnent  and  sflprovanent  of  creativity. 
We  defiiKid  creativity  as  a  two  fold  abili%;.  First,  creating  knowledge 
to  solve  a  pcdbLm  ftqa  tte  eoctemal  envirdnnent;  emd,  second,  cxeatlhg 
the  problem,  as  wall  a^  the  khcwledge-.   integral  to  the  creating  of  both 
•  the  problem  and  knowledge  is  the  criteria  by  \a--ich  ixnsistent  judganent 
can  be  made.  Again,  we  define  two  f onns  of  criteria.   Die  first  is 
criteria  that  are  kncwri  and  which  can  be  applied  with  a  higft  level  of 
consistency.   In  contrast  are  criteria  tiiat  are  developed  concurrently 
with  the  problem  smd/ar  knowledge,  and  is  consistently  applied  across  a 
high  level  of  productivity.   Creativity  cbjoctives  need  to  specify  not 
only  the  ability  to  develope  and  iitpiove,  but  also  the  form  of 
criteria.   Ihat  is,,  students  should  be  informed  of  the  adteria  in  the 
former  and,  in  the  latter,  the  necessity  to  develop  criteria. 

mstructicnal  Methcaa 

m  this  section,  we  identify  Instructional  methods  that  have  dire* 
relationships  to  specific  cognitive-based  cbjectives.  iOso,  these  methods  (or 
strategies)  are  mrpoBed  of  instnictionci  variable  tiiat  have  rich  eampirical- 
bases  of  si^port.   Ihat  is,  instead  of  janeecrib^ng  a  given  stcategy  of 
instruction  for  all  foitms  of  lining,  we  h«*ve  ii^antif led  general  categories 
of  strategies,  eaiA  ccnpoeed  of  variables  that  caun  be  manipulated  according  to 
given  Instructional  situaticniii 

Ihie.  fiye^  instructional  catsgories  are  as  follows: 

Drill-  and  practice.   Ihis  category  represents  those  instru^ 
strategies  designed  to  provide  a  practice  environmerxt  for  learning  declarative 
knpijrledge.   Bie  two  basic  instructional  forms  of  practice  within  this  category 
are  wartod  examples  and  questidiv'problem  repetition.,  !lhese  in  turn  can  be 
fljrther  elaborated  by  various  forms  of  iaranddng  and  ratio  repetition  between 
correct  and  incorrect  patterns  of  response  (see  Saiisbuiiy,  1988,  for  a 
conp^  ete  rmrim  of  drill  and  practice  strategies) . 

f«arkBd  eoenples  is  a  practice  enviironnent  in  vfaidi  the  information  is 
preewited  to  the  student  in  ari  esqjository  form.   She  purpose  is  to-help  the 
student  in  understanding  both  the  context  of  the  infomation  and  -die  structure 
of  infooonation  (i.e.,  orgaiiization) .   Foe  exani^e,.  to  J'aam  a  mathematical 
operation,  the  student  in  presented  the  steps  of  the  process  in  ah  expository 
prcblem  concurrently,  presenting  e>5>lanations  for  each  steo.   In  this  wsy,  the 
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stuaent  can  clearly  unaerstand  the  procedures  of  the  aathenatical  operation 
without  developing  possible  oisoonbeptions  often  occurring  with  discovery 
methods  of  teaching  (I^tkovich  &  Teniiyson,  in  press^ . 

Bie  (jjestioiVfeicoblatt  strategy  presents  selected  infonnation  repeatedly 
until  the  student  answers  or  solves  all  iteoos  at  scne  predetermined  level  of 
proficiency.  The  purpose  h^  is  to  efficiently  aoqaire  the  anbunt  of 
^nCooaation  in  a  Icncwleidge  base.   Differencies  in  questioiv^axblem  strategies 
cane  ficm  the  manipulation  of  tba  ratio  between  correct  and  Inoorxect 
rei^ionses.   Context  is  important  hdre  . because  of  the  students  background 
knowledge  can  determine  ^*etl»r  massed  practice  is  better  than  variable.   If  a 
student,  for  exanple,  has  gbod  badkground  knowledge,  ne^sed  practice  may  be 
Tsac^.  efflclient  because  of  an  eodstlng  orgarized  knowledge  base.  On  the  other 
hand,  if  the  student  does  nbt.have  badkgrCv^  knowledge  in  \*ich  to  elaborate, 
variable  practice  i%  ,be  better  because  tiie  student  heeds  to  develop  scne 
organizatloral  context  for  the  information  in  addition  to  just  the  amount  of 
Anformatich. 

a^tQ^jls.  This  categosy:  of  instructional  strategies  contains  a  rich 
variety  of  variables  and  conditions  to  man^julate  to  liipro"8  learning,  ihis 
category  is  labelled  tutorial  because  the  ciijective  is  to  learn  how  to  use 
kiwwledge  oarrecOy,  therefore,-  it  reqalres  constant  Intervaition  between 
studentvappilmtlon  (e.g.,  prdblen  solving)  and  instructional  system 
monitoring.  Tutorial  siirategies  attenpt  to  create  an  environoent  %*ere  ttie 
student  learns  to  apply  knowledge  to  laienoounteijed  situatioro^jhile  being 
carefully  mcnitored  s^  ais  to  both  prevent  and  correct  posslblia  misoohoeptions 
of  procedural  knowledge. 

^e  basic  Instructional  variable  in,  this  strategy  is  the  presentation  of 
interrogatory  (question)  problems  that  have  not  been  previously  encountered 
(see  Tennyson  &  OoochljBaella,  1986,  for  a  ocnplete  review  of  variables  in  this 
category) .   Other  varleihLes  include  means  for  evelxiation  of  learner  re^xnses 
(e.g. ,  pattern  redog/xition) ,  advisement  (or  coaching) ,  elaboration  of  basic 
information,  organiaition  of  Information,  hunijer  of  problems,  tise  of  eo^ository 
information,  error  analysis,  and  lastly,  refreehment  and  remediation  of 
prereqalsite  information  (Tennyson  &  Christensen,  1988) .  In  sdxollng 
envircnments,  peer  tutoring  has  been  shown  to  laprove  learning  \Aien  tutbrs  are 
txained  with  the  above  variables  and  are  Hatched  intellectually  with  the 
tuted.  Mare  repehtly,  cdopztfsr^aased  tutorial  systems  have  eucxLcyed  advanced 
rule-»3asied  methods  of  progrannlng  to  dsv  '  cp  machine-intelligent  applicaticns 
of  the  above  variables.   Only  the  Mais  s^^stem  has  successfully-  employed  laae 
than  one  of  the  above  varieO^les  iri  an  li^telligent  computer-assisted 
Instructional  program  (Tennyson  &  Park,  1987)  • 

"l^ilMI*^    m  the  instructional  planning  model  (see 
Figure  1) ,  we  propose  that  25%  of  the  instructional  time  be  devoted  to  the 
acquisition  of  conceptual  knowledge.   Bie  proposed  Inirtructional  .st^categy  for 
this  category  uses  a  simulation  t^echnique.  The  purpose  of  slnulatiohs  is  to 
laprove  the  organ' %tion  amd  aidcosslbility  of  information  within  a  knowledge 
base  by  preewntlriyr  pr  olems,  that  require  the  student  to  search  through  their 
inemary  to  locate  and  letzrisve  the  egpropciatie  knowledge  to  propose  a  soLution. 
Within  this  oontepct,  the  sinulation  is  a  problem  rather  than  an  esqpository 
demonstration  of  some  sitsoation  or  phenomenon. 
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In  most  discussions  of  kncwledge  base  organizations,  the  specification  of 
this  accessibility  process  is  elusive.   However,  In  the  field  of  artificial 
intelligenoe,  the  accessibility  process  is  the  aost  inpcctant  ftowtion  of  an 
intelligent  systan.  Within  expert  systems,  connptit-»«1  loxwledge  is  represented 
in  the  fom  of  the  search  rules,  ixiese  rules  are  often  in  tiie  form  of 
producticn  rules  (e.g. ,  IF  IHEN  statanents)  or  hicfher^-order,  meta  rules.  More 
advanced  AI  systoDis  use  ftizzy  logic?  rules  or  ccnditional  prcbetbility  huerlstics 
to  account  for  situations  that  require  inferences  that  do  not  result  in  only 
dicfaotcroous  outocnes. 

Human  nenory  systODDS,  however,  unlike  ccnputei.  ^asec?  AI  aystaD»,  can 
self-generate  the  conceptual  kncwledge  cf  the  kn^rledge  base.  Hhe 
instructional  key  to  iiproving  this  human  cognitive  process,  if»  the  <j|%)urUinity 
for  the  leaner  to  participate  in  solving  donain-fipecific.prcblens  that  have  a 
maaningftLl  context,  tftililoe  prdaleas  in  the  tutorial  strategies  that  focus  on 
aocpuxing  procedural  ]akwledge,  slnnTatiohs  in  this  category  exhibit  tasks 
that  recpiire  eooploiyment  of  the  dcnain's  -gaxxseddrrzl  knowledge.   Otaus,  the 
student  is  in  a  problem  solving  situation  that  reqdres  ^tablishii^ 
connecticns  and  associationB  between  the  facts,  cono^>ts,  rules,  and  priiciples 
of  specific  Jcnains  of  infomnaticn. 

Task-oriented  sinaations  present  domain  specific  problem  situations  to 
iiiprove  the  organization  and  accessibility  of  infdrmation  witliin  the  knwirledge 
base.   Basically,  the  strategy  focuses  on  the  student  trying  to  use  tiieir 
decOarative  ai^  procedural  knowledge  in  solving  domaln-^ecific  probleae. 
Task-oriented  siimjlatlons  present  task  situations  that  require  the  student  to 
(a)  ariulyze  the  problan,  Q>)  work  cvit  a  conceptualization  of  the  problem,  (c) 
define  specif Ic  goals  for  coping  joith  the  problem,  and  (d)  propose  a  solution 
or  decision. 

To  help  students  acquire  a  ridjer  scheaatic  network  for  their  knowledge 
base,  cooperative  learning  groi^  tkiudiqaea  ^'eccas  an  Integral  oGBpunaiL  of 
the  task-oriented  slnulation  strategy^  Witliln:hBtp»x>gen^    grocps,  stutoits 
present  and  r'vbcate  their  req>active  soiutions  to  prbbiene  posed  the 
simulzitloni    ,«search  findings  indicate  that  socialization  is  an  laportant 
condi'jim  in  the  inprovesnent  of  conceptual  knowledge  aoquisitldn  (e.g.,  Vfagner 
&  Stembergj,  1984) .   Miat  is,  the  process  of  jadvocacy  and  controversy  within 
the  grovp  pooovides  an  enviroraoent  for  studentb  to  both  elaborate  and  extend 
their  conceptual  kiKwledge.   lii  other  woras,  task-oriented  simiLations  add 
practical  e3q)erienoe  to  the  knowledge  base  not  usually  acquired  until  placed 
in  a  "real>  ^jiprld'*  environment. 

Prctolem-oaaeihitod  siimlatiQns.   Instructional  metiiods  for  developing 
tiiinking  strategies  aire  often  enployed  independent  of  the  l"amers  knowledge 
bare.   For  exanpl«,  Peuersteln,  Rand,  Hofflnan,  and  Miller  (1980)  present  an 
elaborate  training  program  to  teach  thiridng  sfldlls  1^  having  students  practice 
problem  solving  methods  with  nonsense  tasks.   Ihe  assunption  is,  that  after 
learnli^  a  set  of  generic,  "domaln-irdq)ena^  problem  solving  skills,  these 
skills  (7ui>be  transferred  to  domain 'qiedfic  situations.  However, 
ind^penkntly  derived  enpirical  findings  of  such  training  programs  show 
little,  if  any  transfer  (Erederiksen,  1984) .   Part  of  the  eaqplanatlon  for  the 
failure  of  such  transfer,  is  that  when  dcmain-^je^ific  Instruction  is  given, 
the  focus  is  on  aoguisitldh  of  declarative  and  procedural  knowledcte  rather 
than  either  apqulsition  of  conceptual  knowledge  or  thinking  strategy 


769 


Instructional 


10 

developoaent.  Also,  given  the  poBiplexity  within  the  organization  of  a  tawwledge 
base,  thlrfdng  skills  do  not  pcovide  sufficient  means  to  cope  with  aiy  but  the 
most  slnplest  of  pcoblens  (Gagne  &  Glaser,  1987) . 

to  ocntrast  to  the  aany  training  systeoBs  for  dcBBin-lnii^)enaent  -Uilnldm 
skills  dsvelc(insnt,  sl]iulatic;>s  that  present  dcnain-^)ecif ic  pcoblem 
situations,  allow  learners  to  develop  their  thiridsjg  strsitegies  while  enplcying 
the  dcBoaln  kncwledcye  stared  in  their  nenory  system.  Problent-oriented 
slmalations  exterel  the  fonnat  of  the  task-oriented  siiiulatia»^>ty  use  of  an 
iterative  problem  fomat  ttat  not  only  elbows  the  ocnseguenoes  of  decisions  but 
also  updates  the  situational  qcnditions  and  proceeds  to  make  the  next  iteration 
more  coBoplex.   That  is,  the  siiulation  elKuld  be  longituSiikL,  alloulng  for 
Increasliig  difficulty  of  the  situation  as  well  as  providing  the  adding  and 
drc{plng  of  variables  and  conditions^   m  more  soi^isticated  sisulatiora  these 
alterations  and  changes  ehould  be  done  according  to  Individual  differences. 
Instructional  variables  and  conditions  of  a  prctolem-orlented  siaulation  are  as 
following: 

-Situations  the*  have  a  meanli^gfui  contejrt:  (i.e.,  not  a  game)  that 

regcdre  the  learners  to  use  their  own  knowledge  base; 
-Ocnplex  si(  .atlons  to  challenge  the  learners  differentiation  process; 
r^ituatlois  that  es^cses  learners  to  alternative  solutions  to  iaprove 

their  Integration.^process; 

-Situations  in  whi«^ii  learners  see  challenging  alternatives  x-dthin  each 
leanjer's  cwn  level  of  qcgnitive  ccnplexity; 

-Situations  that  learners  view  as  envirdriaentally  meanlruful  to  develop 
conoQitual  criteria; 

-Situations  that  use  reflective  evaluation  rather  than  right  or  irong 
answers  to  develop  learners  hi^her<ax''ir  concqtol  dciteria; 

-Sitajations  that  allcw  for  continuous  developDaent  of  hi^her^^arder 
thinking  strategies; 

-Situations  t2iat  allcw  learners  to  see  con»eQuenoes  of  their  solutic«s  and 
decisions;  and 

-Situations  taieit  allcw  for  predicting  value  of  future  iitates  of  the 
situation. 

Ihe  aaln  features  of  problem-oriented  simulations  are:    (a)  to  present  the 
initial  variables  and  conditions  of  the  situation;  (b)  to  assess  the  learner's 
proposed  solution;  and      to  establish  the  next  iteration  of  the  variables 
and  conditions  based  oh  the  cumulative  efforts  of  tiie  learner. 

To  ItJrthsr  enhance  the  deveLcanent^  M  inc)i»/ement  of  higheL  border 
thinking  sfjxategies,  we  propose  uie  esat^oiyment  of  cooperative  learning 
methods.   Research  findings  (e.g. ,  Breijer,  1985,  1987)  indicate  that  intrar 
group  Interactions  in  problerar-solvlng  situations  contribute  to  ccgnitive 
ccnplexitir  develcpnent  because  the  learners  are  corfronted  with  the  different 
interpretations  of  the  given  simulation  conditions  by  the  other  group  menijers. 
m  this  MKi/  rmr  Incagrations  between  existing  concepts  within  and  between 
schemata  can  be  estiablished,  alternative  integraf-loret  to  a  given  situation  can 
be  detect;:d,  and  criteria  for  judging  their  ^rallill"^  can  be  developed. 

Ah  Inportant  issue  in  cooperative  learning  is  the  procedure  used  to  groi^ 
sbJidents.  Mxst,  often,  vben  cooperative  learning  grot^  are  used  for  knowledge 
aoguisitdon,  the  students  are  organized  according  to '/heterogeneous  variables, 
sudi  as  gender,  '.3oclp-eooixadc>;  lnt:eilige^  and  eriii^vement.  Hbwever,  our 
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reseeoxh  shews  that  for  developnent  of  thinking  strategies,  graup  menibers 
shcxild  have  similar  abilities  in  oognitiv43  conplexity.  That  is,  within  grcjps, 
students  should  be  ccxifronted  vLth  soluticn  prcpoeals  that  are  neither  too 
nuch  above  cr  below  their  own  levels  of  conplexity. 

For  exanple,  students  with  low  cognitive  ocni>lesdty  beocne  frustrated  skk 
confused  with  hic^y  so|:histicated  solutiora,  while  students  with  high 
cognitive  conpleadty  are  not  only  not  challenged  but  beocne  qoicWy  bored  with 
less  sophi  Bticated-scaiitldns. 

Ohe  fanuat  of  the  Cj-oup  activity  should  enploy  a  ocntroversy  nethod  ^Aiere 
a  consensus  is  reached  following  a  discussion  of  proposals  independently 
deveio|)ed  and  advocated  fay  eachvnenter.   Ohis  fooat  is  in  ccnlrdst  to  the 
ocaplianoe  aethca  %faere  a  consensus  is  reached  fay  meoi^rs  working  together 
frcn  the  start. 

Bie  dontroverBY  BiBthprl  ceui  be  ejq)lained  in  the  following  example  which 
iises  a  coiputerMBBnagienient  system: 

1.  lbs  prci>lem  situation  is  presented  to  the  students^   ihe  ccnputer^ 
based  siaulaticn  prints  out  the  initial  conditions  of  the  situation. 

2.  nie  students  on  ah  individual  basis  stufy  the  situation  and  p^^pare 
an  independent  proposal. 

3.  students  reassenble  as  a  grocp  to  present  their  proposals.  In 
the  initial  presentation,  the  students  are  to  advocate  tJnsiv 
position. 

4.  Pollcwing  the  initial  presentations,  the  students  are  to  continue 
adrocacy  of  their  proposals  in  a  d^te  feahion.   Die  concept  of  the 
ooritroveray  method  is  used  to  help  the  students  further  elaborate 
their  positions  as  well  as  seeing  possible  extensions  and 
alternatives 

5.  Hae  final  goal  of  the  group  session  is  to  prqare  a  cooperative 
proposal  to  ii^put  into  the  siaulation.   Ihis  consensus  is  reached 
only  after  a  conoplete  debate  and  should  represent  the  group's  "best" 
soliition. 

6.  Hbe  dcoputer  program  will  then  update  the  situation  according  to  the 
variables  and  conditiohs  of  the  simulation.   Bie  steps  are  then 
repeated  until  the  conpletion  of  the  siiiulation. 

m  sunmary,  prcblem-oriented  sinulations  are  design^  to  provide  a 
learning  environment  in  vftiich  leairn^  develop  and  inprove  hic^ier-orxSer 
thinking  strategies  ty  engaging  in  situations  that  require  the  enploiyment  of 
their  knowledge  base  in  the  service  of  problem  solving. 

Self-dlrac±P<4  ^>v>'^T^crnn«% -    Creativity  seems  to  be  a  cognitive  ability 
that  can  be  iaproved  by  learners  engaging  in  activities  that  require  novel  and 
valuable  cutoomes.  As  Gaghe  (1985)  has  often  written,  creati\dtir  can  be 
inprDved;by  Instructional  methods  that  allow  stu  'sits  the  oEportunity  to 
create  knowledge  within  tiie  context  of  a  given  donaiii.   l^istructional  programs 
that  provide  an  environment  for  ea^y  manipulation  of  new  information  increase 
the  learning  time  available  for  such  activities.   An  exanple  of  such  an 
environroent  is  1030  (BE^«rt,  1980) ,  a  ocnputer-based  software  program  within 
the  domain  of  mathematics.   1030  is  especially  helpful  for  those  students  who 
currently  have  a  good  declarative  and  procedu2^  knowledge  base  of  mathematics 
and  need  to  elaborate  their  organization  and  accessitoili-^  of  that  knowledge. 
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Other  ocnputer-based  software  programs  provixSe  environments  for  self- 
directed  learning  esqpeidenoes  that  may  in^jrove  creativity  within  given 
donains.   For  exan{d.e,  vrord  processing  programs  have  been  shown  to  isprove 
writing  sikills  because  of  the  ease  in  correcting  and  adjusting  tejtt  i^icture 
(LBwler,  1985) .   Ocn|«ter*ased  simulations  have  also  shown  that  creativity 
can  be  inpxrved  whsn  stuOents  can  boOi  ccntinially  see  tiie  outocmes  of  their 
decisicns  while  understantSing  the  predictability  of  thair  decisicns. 

Creativity  seans  to  be  a  cognitive  ability  that  can  be  laproved  with  use 
within  a,  domain,  and  that  ccnputer'4}ased  sbftware  ptograiiiB  seen  tp^.^sxivide  the 
t^pe  of  eRvirocment  which  can  enhanoe  instructional  nethods  for  Bctki 
iaprovements  (Collins  &  Stevens,  1983) .   Because  of  the  tisa  neoe^ary  for 
participating  in  creative  activities,  educators  should  provide  sufficient 
learning  t±ae  for  sxii  develcpoKnt  (Tenrys^i  et.  al. ,  1988)  ^  Occboter 
softMare  ptoyiaiuB  that  4ice  dcnain  ^)ecif ic  ehhanoe  the  cost-effectiveness  of 
instructicnal  strategies  aimed  at  the  iaprovanent  of  creativity. 

Hbe  key  instructicnal  attribute  for  this  category  is  an  enviroaiment  that 
allcws  students  to  es^jerience  creativity  in  at  tte  moment  **reaa"  time. 
Oonputer  software  programs  that  are  domain  sp&cilia  and  allow  for  self- 
dixected  learning  seem  to  offer  the  best  instructional  methcxi  for  meeting 
goals  of  a  curriculum  t^t  enphasizes  hic^i^level  tdiihking  strategies. 

CcnoQ.usicn 

Ibe  purpose  of  this  pe^  was  to  present  a  model  of  the  learning 
environment  that  directly  allocates  learning  times  w^.th  specific  oo^itive 
learning  cirjectives  and  instructional  methods,  m  pccposed  that  learning  time 
Bee  allocated  aooarding  to  acquisition  and  ectplcjmant  of  a  learner's  knowledge 
base.   Hob  eofiiasis  of  the  model  is  that  acquisition  of  conoeptual  Imowledge 
and  development  and  iinproveroent  of  thinking  strategies  and  creativity  account 
for  70%  of  a  learners  fonML'  learning  time,  and  that  lie  reaainlrig  time  be 
allocated  to  acquisition  of  information.   Because  of  the  foais  on  ccnogitual 
knowledge  and  thiijking  strategies  and  creativity/  in  relationship  to  donains  of 
information,  as  contrast  to  learning  intans&t*:dci  and  thinking  strategies  as 
ind^)endent  instructional  methods,  declarative  and  procedural  knowledge  would 
be  further  acquired  by  the  process  of  elaboration  and  iteration  provided  in  the 
instructional  methods  of  simul^tisns  and  self-directed  experiences. 

In  ccndus:  71,  the  learning  enviiorment:  model  stresses  that  curreriCly 
there  exist  suTlicient  instructional  strategies  to  improve  student-Vlearn^  in 
each  of  the  areas  of  the  learrilng/thiiddng  processies.  That  is,  alt^Scui^  there 
needs  to  be  ccntiiMed  research  in  variables  and  conditions  of  instruction, 
ttmce  are  predictable  instrucitilonal  pnisuriptionB  available  to  now  infxrove 
both  learning  and  thinking.  Also,  wf  recognize  that  there  are  other  goals  of 
azy  educational  curric?;Ium  not  dlBaiseed  in  this  model  and  that  they  need  to 
be  considered  vrihen  designing  a  ccnpr^iensive  curriculum.   Cur  ccncein  was  to 
focus  cr.\y  on  the  variables  and  conditions  of  instruction  for  tiie  inijcovement 
of  knowledge  acquisition  and  employment.   Ihe  meta-learhing  model  provid»a  us 
with  the,  opportunity'  ,t6  Icik  at  the  whole  range  of  learning  dbjectives  without' 
the  constraints  of  mieeting  the  conditions  of  a  g:!-ven  learning  or  instructional 
theory.   It  was  within  that  context  that  we  weLe  able  to  define  meta- 
instrucWqial  inethods  with  prescribed  learning  times. 
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Our  hcpe  is  that  this  instructional  planning  model  will  offer  a  baseline 
for  further  discussiai  on  the  inportant  issue  of  instructional  time  and  the 
inproyenent  of  learning* 
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INTRODUCTIUN 


This  presentation  describes  the  a.ssumptions  and  methods  of  a 
CAI  desiQn  process  that  teachers  can  use  to  design  CAI  software.  The 
design  model  is  intended  to  facilitate  software  design  by  teachers 
who  may  not  know  how  to  program  a  computer j,  but  the  model  can  be  used 
by  teacher-programmers  as  well.  The  model  is  intended  for  teachers 
at  all   levels,  elementary,  secondary,  and  postsecondary.  Th'e  model 
has  been  field  tested  with  secondary  and  postsecondary  instructors 
as  a  textbook   (Tessmer,  Caverly,  ?<  Jonassen,   in  prens)   in  the 
graduate  teacher  education    program  at  the  University  of  Colorado  at 
Denver. 

The  textbook  is  a  workbook  that  guides  students  through  the 
design  of  a  CAI  lesson  on  paper.   In  this  presentation,  we  would  like 
to  explain  three  components  of  this  design  model  exemplified  in  this 
text;  1)  the  assumptions  that  underlie  the  instructional  content  and 
methods  of  the  text,  2)  the  instructional  methods  themselves  and  3) 
the  results  of  our  use  of* the  workbook  in  a  teacher  training  class. 

To  begin  with,  we  would  like  to  define  several  terms  that  will 
be  used  in  this  presentation: 

1.  "CAI  Strategy".  When  we  speak  of  a  CAI  strategy,  we  are 
speaking  of  ways  a  teacher  can  use  the  computer  to  facilitate 
learning  of  a  given  learning  outcome.  Thefse  methods  include 
tutorials,  drill  and  practice,  simulations,  games,  and  problem 
solving  tools  such  as  database  management  tools.  These  strategies 
may  or  may  not  involve  stand-alone  CAI  instruction. 

2.  "Programming".  We  oelieve  there  are  two  types  of  CAI 
programming: 

a)  programming  as  coding,  the  more  common  definition  of 
programming,  involves  entering  the  program  commands  into 
the  computer, 

b)  programming  as  content  and  structure  design,  involves 
specifying  the  lesson  content  and  structure  in  screen  displays. 
In  this  second  type  of  programming,  the  CAI  program  is  created. 
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As  we  shall  see,  we  asBume  that  these  programming  types  are  not  cnly 


conceptually  but  realistically  distinct.   Inotherwords,  both  t:ypss  o-f 
programming  can  be  done  by  the  same  or  separate  people  -for  the  same 
CAI  lesson. 


Ih^  Qf ■  IlSchers  in  Software  Design  and  Production 

leschers  wil,l,  continue  to  ECQduce  their  own  comQuter 
software^^  The  quality  of  commercial  CAI  so-ftware  is  increasingly 
better,  but  teachers  will  still  produce  their  own.  This  is  because: 

a)  as  with  all  media,  some  teachers  prefer  to  'Voll  their  own" 
regardless  of  the  quality  of  available  scf  iware  and  the  timt^^  .\t 
takes, 

b)  there  is  still  a  large  amount  oV  poor  quality  software  for 
many  content  areas  (Schiffman,   1986;  Smith,  1987), 

c>  computers  are  increasingly  available  to  teachers  at  all  levels 
of  schooling, 

d>  more  districtwide  support  is  available  for  teachers  to  design 
software, 

e)  mc;'*e  teachers  are  becoming  comfortable  with  computers  and 
thus  are  willing  to  try  developing  CAI, 

f)  programming  help  for  software  development  is  increasingly 
available  to  teachers. 

g>  When  teachers  must  code  CAI  themselves,  the  latest 
authoring  systems  (e.g.  Course  of  Action)  make  it  increasingly 
easier  to  code  a  CAI  lesson. 

2.  Teachers  should  not  have  to  code  a  comguter  to  ECQQCSiD  L%.jl 

feh§b^  ECQ9CSQ!  it  througl^  the  design  of  screen  di.5Bl.ai/5^.  Better 

software  is  produced  when  the  teacher  can  spend  time  on  the  design 

of  the  CAI  program  on  paper  screen  displays,  which  then  can  be  given 

to  a  programmer  for  program  coding.  This  allows  the  teacher  to 

concentrate  on  the  content  and  teaching  methods  of  the  program 
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(although  programming  knowledge  is  helpful).  Screen  displays  are  job 
aiids  that  help  teachers  format  the  information  properly.  As  Hasen 

(1985)  indicates,  good  formatting  has  motivational  as  well 
instructional  properties.  More  important,  screen  displays  guide  the 
teachers  into  a  frame-based  approach  to  software  design,  an 
approach  that  is  effective  for  a  variety  of  CAI  strategies  (Bonner, 
1987)*  Most • important ,  using  screen  displays  forces  the  teacher  to 
design  the  program  on  paper  before  any  coding  is  done,  so  that  tht/ 
pay  attention  to  'che  content  and  methe;ds  of  the  instruction, 
improving  the  instructional  validity  of  the  product. 

3*  Id  fliSQy  scfiggi  settingsj.  teachers  will,  vynctign  the 
designers  and  subigct  matter  eMgerts  of  the  EroQrgmj^  but  do  not  tjaye 
t9  fUQStiSD  ^§  ihg  E!1Q9C§!D  SQderSj;.  and  sjiguld  ngt^^^  t'everal  CAI 
designers  recognise  that  the  ideal  software  productior^  team  in 
education  consists  of  a  de^>igne*^     teacher,   and  programmer   (Col lis  ?< 
Gore,   19S7;  Smith,   1987).  However,   instructional  designers  are  not 
readily  available  to  most  teachers,  particularly  at  the  elemrntary 
and  secondary  school  level.  On  thfc  other  hand,  programmers  are 
becoming  more  prevalent,  particul ^.rly  at  the  secondary  level?  where 
students  are  more  proficient  programmers. 

4.  In  mgst  schgol  settinQSj.  instructicnal  software  wi,ll  he 
ytlLi2gd  in  situatigns  where  the  teacher,.  studgntSjL  (nediaj.  and  other 
Ctsgurcgs  are  ayai  1  able  to  suQBlement  tjie  CAI  lesson,^  the  sc^.tware 
dggs  not  usual l^y  fynctign  as  g  stand-algne  lesson^.  As  Sch  ffman 

(1986)  has  indicated,     teachers  incorporate  software  within  an 
overall  teacher-designed  Ifisson  plan  that  can     include  a  variety  of 
off-screen  activities  in  the  lesson.  These  activities  involve  peer 
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consultation,  worksheets,  practice  and  testing,  and  teacher  help. 

Methods  for  Learning  Software  Design 

1  •  leachers  best  1  earn  how  to  "Brogragi"  a  comgut er  through  a 
ttitQCiilL  workbook  aggroachi  This  approach  allows  them  to  gradually 
plan  their  lesson  through  workbook  exercises  in  each  chapter  o-f  the 
text,   and  then  convert  the  exercises  directly  into  screen  displays 
for  final  coding.  A  workbook  requires  the  student  immediately 
applies  what  they  have  learned  in  a  chapter  to  their  own  project, 
avoiding  the  mistake  of  the  "now  let's  put  it  all  together 
approaches"  of  books  that  merely  describe  CAI.  These  books  require 
the  novice  tu  synthesize  all  that  they  gave  learned  at  the  very  end 
of  the  book,   or  they  just  offer  descriptive  advice  with  no  design 
activities  whatsoever.  Also  in  a  workbook,   teachers  first  devote 
their  efforts  exclusively  to  the  design  of  the  content  and  methods 
of  the  program  and  not  to  how  to  code  it  or  even  design  it  on  screen 
displays.   After  teachers  have  designed  a  program  once  or  twice  in 
this  manner,   they  can  then  use  screen  displays  immediately  for 
lesson  design. 

2.  Iq  design  effective  CAIj^  teachers  need  to  learn  a  few  basic 
iQstructigna]^  events  that  unigyely  sui t  the  botf]  the  learning 
outcome  and  CAI  strategy  they  use-.  As  Resnick    (1976)   has  argued, 
learners  can  elaborate  upon  a  skilled  performance  routine  once  they 
h'ave  mastered  a  basic  routine.   Although  they  are  usually  novice 
programmers,  teachers  have  a  repertoire  of  teaching  techniques  and 
strategies  that  they  use  in  instruction.  What  they  need  to  know  are 
the  essential   instructional  events  for  the  given  learning  outcome 
and  CAI  strategy  they  teach.  They  will  embellish  these  with  their 
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own  instructional  events  as  they  design  the  program.  The  mistake  of 
many  CAI  design  books  is  they  try  to  teach  too  many  design  options 
and  -factors  -for  a  single  type  of  approach?  they  overload  the  novice 
with  detail  and  options,  depending  on  the  novice  to  "figure  out" 
what  they  need  for  their  lesson^  or  for  a  teacher  to  teach  them. 
These  books  often  do  not  allow  the  student  to  construct  anything  as 
part  of  the  text  activities,  nor  do  they  furnish  any  programmintg 
guidelines  via  job  aids. 

3.  Teachers  should  learn  the  aeneral^  t^jQes  of  CAI  strategies 
§Dd  tbl  tiJBes  of.  learning  oytcgmes^.  which  can  be  used  to  iiioit  the 
ClQCje  of  BQSsibie  CAI  iessgn  features  to  those  that  suit  both  the 
strategy  and  outcome^j^  Teachers  learn  to  apply  this  limited  set  of 
design  options  to  create  a  CAI  lesson,  and  to  embellish  them  with 
their  own  teachin'g  methods. 

ECQQ'fZ^/n  Characteristics  of  Effective  CAI 

1-  Effective  CAI  design  is  Qutcgme-based^  The  key  to  the 
teacher^s  selection  of  apropriate  CAI  lesson  characteristics 
lies  in  their  classification  of  the  learning  outcome (s)  of  that 
lesson.  The  learning  outcome  of  a  CAI  lessor  helps  determine  the 
lesson  objectives,   learner  readiness  activities,  instructional 
content     and  methods,-  practice  and  test  items,  and  formative 
evluation  criteria.   To  classify  outcomes,  teachers  learo  to  write 
objectives,  conduct  simple  task  analyses,   and  describe  the 
characteristics  of  different  learning  outcomes. 

2. Effective  CAI  lessons  e/nbgdy  a  /niEHQstC^tegi:  _(ng  gun  intended), 
cgrnggsed  of  instructignai  events  that  suit  both  the  iearnina  gutcg/ne 
and  aenerai  CAi  strategy;  selected  by  the  teacher ^  There  are  five 


ERIC 


basic  types  of  CAI  strategies?  (deductive/inductive  tutorial,  game, 
simulation,  dri 1 1 /practi ce,  problem  solving  tools).  Each  has  a 
di-f-ferent  set  o-f  instructional  events  that  are  embodied  in  the 
program,  depending  upon  the  learning  outcome  of  the  instruction 
(concept  learning,  rule/principle  learning,  verbal  information, 
problem  solving).  This  actually  creates  a  5  m  4  matrix  of  types  of 
CAI   (Figure  1).  This  matrix  approach  elaborates  upon  the  Gagne, 
Wager,  and  Rojas  approach  (1931),  in  that  the  CAI  designer 
selects  instructional  events  not  only  by  learning  outcomes,   but  also 
by  CAI  strategy. 

Regardless  of  the  CAI  strategy  used,   the  outcome-based 
performance  remains  the  same  for  a  -^iven  learning  outcome  (i.e., 
whether  it  is,  a  simulation  or  tutorial,  example  classification  is  a 
requisite  student  performance  in  the  lesson).  However,  the 
instructional  events  vary  for  the  same  outcome  depending  on  the 
strategy  .("eliciting  the  response  "  differs  in  a  concept  game  vs. 
problem  solving  tool  vs  inductive  tutorial)..     In  some  cases,  an 
event  may  not  be  present  at  all    (no  "present  the  Information"  event 
in  a  game  or  problem  solving  tool).   Teachers,  then  learn  lesson 
design  best  by  learning  how  to:   a)   identify  the  outcomes  of  their 
lesson   (the  mrst  crucial  step),   b)   select  a  CAI  strategy  for  that 
outcome,  and  c)  utilize  the  instructional  events  of  that 
strategy /outcome  microstrategy  to  design  the  instructional 
component  of  the  lesson. 

3-  Everj^  CAI  lesson  should  contain  an  introductory  Bliidiness 
f9C  Le^CDiDQ  {Dicrostrateay  that  encomeasses  two  eyentsi  ai  rec.All  of 
BCiQC  kQQwildaij.  fel  BC§E3C3£iQD  fQC  Q§y  kOQwi^dae^  These  elements 
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are  distinct  in  their  definition  and  their  effects  on  learning.  They 
each  can  be'done  by  the  computer  or  via  off-screen  activities.  They 


iffectiye  CAI  lessons  can  utilize  off^screen  activities  as 
BiiElt  of  their  (Di £CQ5trategy  eyentSi.  In  many  cases,,   asking  the 
student  to  consult  a  book^  teacher,  or  student  may  be  a  viable  part 
of  the  computer  lesson   (especially  for  problem-solving  outcomes  that 
have  practice  and  evaluation  components  that  are  difficult  to  design 
for  a  novice  programmer).   In  particular,  research  has  indicated  that 
diadic  and  triadic  student  groupings  can  facilitate  learning  and 
performance  in  problem  solving  activities.  For  example,  readiness 
activities  can  be  conducted  by  the  instructor  before  students  start 
on  a  lesson.   This  CAI  design  assumption  is  particularly  crucial  to 
CAI  designers  that  are  teachers,  for  two  reasons:  a)  experienced 
instructors  can  utilize  lesson  activities  that  they  know  ,^ave 


worked,  even  if  they  cannot  be  programmed  into  the  computer,  b)  CAI 
lessons  with  off-screen  activities  can  be  easier  to  design  and  code 
■than  a  similar  stand  alone  lesson  that  programs  all  activities  into  the 
computer.  Once  off-screen  activities  are  legitimized  as  part  of  the 
overall  CAI  process,  teachers  lose  the  common  and  harmful 
presupposition  that  CAI  instruction  must  all  be  in  the  computer  as  a 
stand— alone  process;  that  using  media,  text?   or  people  is 
"cheating  ** . 


are  at  once  the  two  most  neglected  but  important  components  of  a  CAI 


I esson. 


785 


ERIC 


THE  INSTRUCTIONAL  PROGRAM  USED  TO  TEACH  OUR  CAI  MODEL 


First,   students  receive  an  overview  of  why  and  how  instructional 
design  is  done  for  CAI.  Following  that,   the  student  learns  how  tos 

1.   Determine  the  objectives  of  a  lesson. 


2.  Conduct  a  task  analysis  of  the  lesson   (hierarchy  or  info  processing) 


I 


3.  Classify  the  learning  outcome(s>   of  the  lesson 


I 


4.  Design  a  Readiness  for  Learning  lesson  component 

i.  assess  prior  knowledge  of  the  learner 

ii.  recall  prior  knowledge  in  learner 

i  ii .   describe  objectives  Z<  content  of  lesson 


1 


5.   Design  the  CAI  instructional  component: 

Firstj,  by  choosing  outcome  to  be  taught   (several  cycles 
of  this  may  be  completed  in  one  lesson,   for  multiple 
outcomes) . 

Second,  by  choosing  instructional  strategy  for  the  given 
outcome   (tutorial ,  game,   etc. ) . 

Third,  determining  the  necessary  microstrategy  of  instruc- 
tional events,  based  on  text  prescriptions  and  tsacher 
e^jperience. 

Fourth,  f ol lowing  workbook  guidelines  to  construct  lesson 
•  component  on  paper . 


1 


6.  Convert  workbook  program  design  into  screen  displays. 


I 


7.  Conduct  formative  eval uation  of  1 esson  vi  a  screen  di  spl ays. 
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EVIDENCE  OF  THE  MODEL  ='S  SUCCESS 
(This  will  be  summarized  in  the  presentation) 

Bg§ylt§  si  §BBCS§£tlI.  no  hard  empirical  data:  this  is  hough  to 
derive  when  evaluating  the  effectiveness  of  a  semester-^long 
intervention  via  use  of  a  course  text.  Howeverj,   15    graduate  teacher 
education  students  in     a  Spring  ""37  class  used  the  approach  in 
designing  tutorial  software.  Their  instructional  products  using  a 
Superpilot  system  were  all  at  the  A  or level  for  a  project  grade 
(as  graded  by  the  authors  of  this  presenation) ,  with  appropriate 
readiness  activities,   interactivity,   and  practice  sequences. 

The  biggest  student  difficulty  in  the  course  was  in 
appropriately  identifying  the  proper  learning  outcomes  (confusion  on 
rules  vs.   concepts,  rules. vs.  problem  solving).   However,  students 
tended  to  embody  the  basic  instructional  events  for  each  type  of 
outcome  in  their  lesson,  and   (as  we  hoped)   transcend  these  with  the 
addition  of  their  own  supplementary  design  components,  indicating 
that  teachers  may  not  have  to  be  taught  all  design  components  for 
each  CAI  strategy /outcome  as  much  as  they  need  to  learn  the  basic 
microstrategy  instructional  events  from  which  to  work.  Students" 
course  ratings  were  highest  on  survey  questions  about  the  ease  of 
use  of  the  workbook  and  its  help  in  achieving  course  goals.  Since 
students  programmed  their  lessons  themselves,  we  were  not  able  to 
test  the  premise  that  a  teacher^'s  screen  displays  can  be  coded  into 
the  computer  by  another  programmer. 


OTHER  FEATURES  OF  OUR  APPROACH 
(Included  in  AECT  presentation  if  time  permits) 
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1-  ^MBlanatory  feedback  should  be  B.!lQvi,ded  for  ri.g[ht  answers^ 
which  are  more  than  iugt  conf i,rmat i,on  of  succesSi.  This  is  because 
students  can  guess  at  right  answers,  and  also  make  "correct  but 
not  perfect"  answers  that  have  some  mistakes  in  them   (Hazen,  1935). 
Also,   different  types  of  wrong  answers  receive  different  types  of 
feedback,   depending  on  the  type  of  wrong  answer,  and  number  of 


2«  Use  of  learning  strategies  as  an  oetion  for  tutorial 
BCOQEI^IDSi.  In  the  workbook,   teachers  are  shown  how  CAI  lessons  can 
ask  students  to  generate  their. own  images,  mnemonics,  or  examples 
for  a  given  learning  outcome. 

"  3.  Deemehasis  of  vj^rbal  information  CAI.  iessgns^  Teachers  are 
told  that  verbal  information  lessons  can  be  more  efficiently  taugh ' 
outside  of  CAI.   If  verbal  information  is  a  prerequisite  of 
ir^tel  lectual   skill  of  the  CAI  lesson,   it  can  be  taught  on  the 
computer. 

4-  R§£§!l§Q£gzteMt  aegrr^ch.^  For  the  first  part  of  the  book, 
everyone  learns  .the  same  necessary  design  activities   (task  analysis, 
objectives,  outcomes,  readiness  for  learning).  For  the  next  part., 
students  can  reference  individual  sections  of  the  book,  depending  on 
the  outcomes  they  are  trying  to  teach-    In  the  last  section,  everyone 
completes  the  same  section  on  screen  display  design.  This  allows  for 
a  learn-as-needed  approach  to  CAI  lesson  design.  With  this  format, 
the  book  can  also  be  used  as  a  reference  tool  for  on-the-job 
courseware  design. 

As  part  of  a  formal  course,  teachers  can  also  complete  all  the 
workbook  exercises  in  each  chapter,  to  achieve  a  better  understanding 
all  types  of  CAI  instruction.  This  is  explained  in  a  How  to  Use  this 
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Book  section  of  the  workbook,  a  feature  missing  from  too  many 
instructional  texts, 

5,  3  Stages  of  formative  evaluation^.  The  book  e^cplaihs  that 
there  are  three  cycles  of  formative  evaluation  that  can  be  conducted* 
for  CAJ:   a)   evaluation  of  the  front-end  analysis  of  objectives  and  task 
analysis  by  an  SME  (a  teacher  or  a  designer),  b)   evaluation  of  the 
screen  displays  by  students  and/or  an  SME,  c)  evaluation  of  the 
lesson  on  the  computer- 
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Figure  1 
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Background 

For  much  of  its  history,  education  In  this  country  has  meant  "school  operations  that  were  uniform  In  reflecting 
group  norms"  (Fantlnl,  1980,  p.  28).  Much  of  the  research  In  education  has  been  directed  along  the  lines  of  finding 
the  best  method  for  delivering  Information  to  a  nonrative  group.  The  assumption  wac  that  there  was  one  method 
that  was  best  for  all  students.  .As  a  result,  educational  programs  were  designed  for  groups  of  students,  such  as  a 
particular  grade  or  age  level. 

In  daily  practice  this  required  each  student  to  adapt  as  best  as  he  or  she  could  to  the  educational  method 
being  used.  Y^t  few  people  woi  !d  deny  that  in  any  group  of  students  there  exists  a  wide  range  of  differences  In 
ability  to  handle  information  in  a  subject  area.  Those  most  successful  at  adapting  to  the  instructional  method  being 
used  advanced  within  the  educational  system,  while  those  less  able  to  make  use  of  what  the  system  offered  often 
withdrew  and/or  were  placed  in  special  tracks. 

Educators  have  long  expressed  dissatisfaction  with  this  approach.  In  1911,  Edward  L  Thomdlke  called  for 
breaking  away  from  this  uniformity  In  order  to  design  instruction  better  suited  for  the  needs  of  the  indivWual.  This 
thinking  was  echoed  by  Carieton  Washbume  In  1925.  In  his  introduction  to  the  twenty-fourth  yearbook  of  the 
National  Society  for  the  Study  of  Education  entitled  "Adapting  the  Schools  to  IndivkJual  Differences,"  he  wrote: 

Throughout  the  educational  worid  there  has  therefore  awakened  the  desire  to  find  some  way  of  adapting 
schools  to  the  differing  indivkJuals  who  attend  them.  (p.  x) 

To  date,  however,  little  progress  has  been  made  in  designing  and  implementing  instruction  for  the  Indivkiual. 
Although  educational  reformers  have  introduced  a  variety  of  innovations,  most  of  these  innovations  have  not  dealt 
with  IndivkJual  differences  of  the  students.  The  majority  of  these  approaches  have  been  comparisons  between  new 
"Method  B"  applied  to  all  the  students  and  existing  "Method  A,"  As  a  result  new  methodologies  have  seldom  shown 
any  real  improvement  in  the  educational  process. 

Individualizing  Education 

The  concept  of  designing  Instruction  for  the  individual  rather  than  for  a  group  has  received  renewed  interest  In 
the  past  two  decades.  Snow  and  Salomon  (1968)  state: 

if  the  variables  used  to  stratify  the  group  are  well  chosen,  then  at  least  the  stage  has  been  set  for  a  new  kind  of 
Instructional  improvement,  one  based  on  the  hypothesis  that  there  Is  no  "one  best  way"  to  teach  anvthlnq  (d 
343).  «VK- 

In  1980  Fantinl  wrote  about  the  progress  to  date: 

The  age-old  fact  that  no  two  people  are  alike,  that  they  have  different  needs,  unique  interests,  talents, 
aspirations  and  problems,  and  learn  In  different  ways  has  finally  begun  to  penetrate  the  mainstream  of  our 
schools.  Consequently,  the  school  front  has  become  the  scene  of  a  revolutionary  struggle  to  alter  institutional 
uniformity  geared  to  group  norms  toward  structures  In  which  the  IndivkJual  uniqueness  of  the  learner  is  given 
fuller  play... 

Attempts  to  find  one  method  that  would  reach  100  percent  is  fruitless...  The  point  Is  that  we  are  now  at  a 
stage  theoretically  and  practically  In  which  we  should  be  able  to  generate  the  capacity  to  tailor  programs  to  fit 
IndivkJuals.  No  one  method  can  be  conskJered  superior  to  the  other  except  as  It  contributes  to  the  learning  of 
the  IndivkJual  (p.  28, 30). 

Ausubel  (1968)  defined  perception  as  an  awareness  of  an  object  or  event  prior  to  the  cognitive  processing  of 
that  object  or  event.  Due  to  the  amount  of  Information  to  which  people  are  exposed,  perception  must  be  selective. 
This  selection  is  based  upon  their  experiences,  expectations,  goals,  values  and  other  influences--in  other  words, 
their  IndivkJual  differences.  People  continually  scan  the  available  stimuli  and  select  certain  stimuli  for  processing. 
Exactly  how  a  person  scans  a  field  and  to  what  parts  he/she  pays  attention  is  greatly  influenced  by  differences 
within  the  IndivkJual.  By  looking  at  how  indivkJuals  differ  on  certain  variables,  it  may  be  possible  to  make 
predictions  as  to  what  parts  of  the  environment  they  will  process.  By  relating  this  information  to  learning,  it  then 
becomes  feasible  to  apply  it  In  the  design  of  instruction. 
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The  Study 


The  current  study  attempts  to  relate  an  Individual  difference  variable  to  one  aspect  of  learning.  The  learning 
process  being  used  Is  the  ability  of  the  student  to  read  and  understand  text  Infonnatlon  presented  on  a  computer 
screen.  The  study  employs  the  Trait-Treatment-Interaction  orTTI  methodology  using  field  dependence- 
Independence  as  the  trait. 

ThIsstudyfollowsthe  writings  of  several  authors  (Snow  and  Salomon,  1968;  Glaser,  1972;  Ingersoll,  1974;  DI 
Vesta,  1975)  who  have  suggested  that  the  emphasis  In  research  on  learning  should  be  on  the  cognitive  processes 
of  the  Individual  wori<Ing  with  a  particular  leaming  performance. 

Both  traits  and  treatments  may  affect,  and  In  some  cases  will  dictate,  whether  the  receivers  will  attend,  to  what 
they  attend,  whether  they  will  try  to  leam  by  rote  or  for  understanding,  whether  they  will  fonn  Images  or  verbal 
statements,  whether  they  prefer  to  use  the  visual  over  the  auditory  modality,  and  so  on  (DI  Vesta,  1975,  p. 
189). 

The  TTI  methodology  was  chosen  because  it  allows  the  manipulation  of  one  or  more  treatments  In 
conjunction  with  traits  of  the  participants.  The  results  are  intended  to  show  how  Interactions  between  one  or  more 
of  the  treatments  and  one  or  more  traits  of  the  subject  affect  the  outcomes. 

Raid  dependence-Independence  is  used  as  the  trait  because  it  has  been  the  subject  of  considerable  study 
and  a  number  of  the  characteristics  identified  with  field  dependent  or  field  independent  Individuals  seem  to  have  a 
relationship  to  leaming.  Generally,  field  dependent  Individuals  are  governed  to  a  large  extent  by  the  organization  of 
the  field.  Reld  independent  individuals  are  characterized  by  an  articulated  cognitive  s^   This  type  of  person 
analyzes  and  structures  experiences  depending  upon  the  task  at  hand  and  Is  not  as  easily  influenced  by  a 
structure  that  is  present. 

Neither  end  of  the  continuum  Is  deariy  superior  In  concept  attainment  or  other  aspects  of  leaming.  Reld 
dependence-Independence  Is  related  much  more  closely  to  how  people  leam  than  to  how  much  is  learned. 
A  list  of  field  dependent-independent  characteristics  that  relate  to  leaming  Include: 


Field  Independents 


Field  Dependents 

1 .  Talce  organization  of  field  as  given. 


1.  Impose  organization  of  unstructured 
field. 


2.  Sample  fully  from  the  nonsallent  features 
of  a  concept  In  order  to  attain  the  relevant 
attributes  and  to  fonn  hypotheses. 


2.  Dominated  by  the  most  salient  features 


of  a  concept  (n  the  attainment  of  the 
relevant  attributes  and  In  hypothesis 


fonnatlon.  Can  sample  fully  from  set  of 
features  if  they  are  in  discrete  form. 


3.  Utilize  the  active  approach  to  leaming, 
the  hypothesis  testing  mode. 


3.  Utilize  the  passive  approach  to 
leaming,  the  Intuitive  mode. 


4.  Leaming  curve  Is  dIscontinuous-no 
significant  Improvement  in  leaming  a  new 
concept  until  the  appropriate  hypothesis 
is  found,  then  sudden  Improvement. 


4.  Leaming  curve  Is  continuous-gradual 
improvement  as  relevant  cues  are  sampled. 


5.  Use  mnemonic  structures  and  reorganize 
materials  for  more  effective  storage  and 
retrieval  of  information. 


5.  Use  existing  organization  of  materials 
In  cognitive  processing. 


6.  Leam  to  generalize  to  object  and  design 
concepts  more  readily. 


6.  Less  effective  In  generalizations  from 
original  design  to  variations  on  basis  of 
common  components. 


7.  Prefer  to  leam  general  principles  and 
acquire  them  more  easily. 


7.  Prefer  to  leam  specific  Information  and 
acquire  It  more  easily.  (Thompson,  1987) 
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Reming  and  Levie  (1978)  state  that  performance  on  a  learning  task  Is  more  rapid  if  the  salient  cues  are 
relevant  and  less  rapid  if  the  salient  cues  are  in^elevant  to  the  learning  taslc.  Since  field  dependents  tend  to  be 
dominated  by  salient  cues,  and  ignore  nonsallent  cues,  Goodenough  (1976)  hypothesized  that  when  the  salient 
cues  are  relevant,  field  dependents  would  learn  the  material  at  least  as  easily  as  field  independents  since  they  ^eld 
dependents)  pick  out  the  salient  cues  for  processing.  He  further  sugg^ted  that  field  dependents  might  learn  the 
material  more  easily  under  these  conditions  due  to  their  reliance  on  salient  cues. 

WItkin  et  al.,  (1977)  found  that  field  dependent  people,  who  lack  the  ability  to  organize  or  structure  Infomiatlon 
Internally,  are  akled  by  materials  that  provWa  structure.  The  more  structured  the  mediator  the  more  that  field 
dependent  person's  perfonnance  was  helped. 

A  previous  study  using  FDI  and  center  and  skJe  headings  as  salient  cues  in  printed  instructional  text 
(Thompson,  1987)  dkJ  show  an  improvement  in  the  scores  for  field  dependent  participants  when  the  cues  were 
present.  In  addition,  field  independent  participants  scored  higher  when  using  the  text  without  the  headings.  This 
latter  finding  seems  to  indicate  that  the  imposed  structure  interfered  with  the  cognitive  processing  of  the  field 
Independent  participants. 

Based  upon  this  research,  it  appears  plausible  that  FDI  has  an  Influence  upon  the  way  in  which  an  indivMual 
gains  information  from  his/her  leaming  environment  A  problems  arises  in  the  fact  that  the  delivery  system  was 
printed  text  This  severely  limits  the  amount  of  IndMduallzIng  of  Instruction  a  teacher  can  do,  if  different  versions  of 
handouts  must  be  generated  within  each  group  of  students. 

With  the  increase  of  newer  technologies  in  the  classroom,  a  possible  solution  to  this  logistical  problem  has 
presented  itself.  Restructuring  informatk)n  for  Indivkiuals  is  a  relatively  simple  task  when  using  a  microcomputer  as 
the  delivery  system.  Therefore,  instructional  text  as  presented  on  a  microcomputer  screen  has  been  chosen  as  the 
medium  for  distiibuting  the  instructional  infonnation.  Specifically  this  study  will  attempt  to  determine  if  the  presence 
or  absence  of  headings  akJs  in  the  cognitive  processing  of  the  material  as  presented  on  a  microcomputer  screen. 

Methodology 

The  parttelpants  in  the  study  will  be  classified  on  the  indtvklual  difference  variable  field  dependence- 
independence  using  the  Group  Embedded  Rgures  Test  Then  the  participants  will  be  divWed  randomly  into  two 
groups:  one  half  will  receive  a  selection  of  Instructional  text  on  a  microcomputer  containing  key  words  used  as 
center  and  sWe  heading;  the  other  group  will  receive  the  same  selection  of  instructional  text  minus  the  center  and 
sWe  headings.  After  reading  the  Instnjctional  text,  both  groups  will  take  an  objective  test  over  the  information. 

The  sample  for  the  study  will  be  approximately  200  undergraduate  college  students  enrolled  in  at  the 
University  of  Wisconsin  Stevens  Point  during  1987-1988.  The  approximate  age  range  of  the  students  is  18  to  30 
years.  An  undergraduate  college  population  was  chosen  because  the  indivWual  difference  variables  used  here  are 
relatively  stable  at  this  age  (Wolitzky  and  Wachtel,  1973). 

Hypotheses 

Based  upon  the  review  of  the  literature  the  following  hypotheses  have  been  developed: 

1 .  There  will  be  a  significant  difference  between  field  dependent  participants  and  field  independent 
participants  on  scores  of  tests  over  instructional  text  with  center  and  sWe  headings  and  without  center  and  side 
headings. 

2.  Reld  independent  participants  will  score  significantly  higher  than  field  dependent  participants  on  tests  over 
instructional  text  when  the  instructional  text  does  not  contain  center  and  skJe  headings. 

3.  Reld  dependent  participants  will  score  at  least  as  well  as  field  independent  participants  on  tests  over 
instructional  text  when  the  instructional  text  does  contain  center  and  skle  headings. 

Statistical  Analysis 

The  design  of  this  study  involves  the  use  of  two  independent  variables-field  dependence-Independence,  and 
the  presence/absence  of  center  and  skJe  headings  In  the  instructional  text,  and  one  dependent  variaWe-the  score 
on  a  written  test  over  the  reading  material.  For  these  reasons  the  statistics  chosen  will  be  a  two-way  analysis  of 
variance. 
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Introduction. 

A  major  criticism  of  the  field  of  Educational  Technology  has 
5®^  tried  to  be  all  things  to  all  people.  Referring  to 

r«^i"^^^°"®  °^         ^^^^^  (^ly*  1972;  Silber,  1970;  Rowntree,  1974; 
AECT,  1977) ,  Nunan  (1983)  points  oat  that  Educational  Technology 
appears  to  claim  a  role  in  all  aspects  of  Education,  differing  only 
from  the  other  subfields  by  being  more  systematic  in  what  it  does. 
This,  added  to  the  tendency  to  equate  the  practical  application  of 
knowledge       our  stock  in  trade  ~  with  a  rejection  of  theory,  has 
led  to  a  situation  where  the  field  is  being  pulled  in  many 
directions  at  once  and  lacks  an  anchor  point  to  give  it  stability. 
It  is  therefore  necessary  to  identify  what  the  theoretical 
foundations  of  the  field  are  and  to  propose  how  the  field  can  build 
xtself  up  from  a  solid  foundation  in  theory.  The  recent  book  by 
Gagne  (1987)  takes  an  important  step  in  this  direction  in  that  its 
chapters  concentrate  for  the  most  part  on  learning  and  instruction. 

attempts  to  go  further  in  this  direction  and  to  strip  the 
field  down  to  its  essentials. 

*  °^  paper  is  not  to  suggest  another  definition 

for  the  field.  Rather  it  seeks  to  examine  an  extant  one  in  such  a 
way  as  to  make  the  field's  foundations  clearer.  The  definition  is 

new  to  Educational  Technologists.  It  is  based  on  Galbraith's 
^  4    L2?  °"  °^  technology  as  "the  systematic  application  of 

scientific  and  other  organized  knowledge  to  practical  tasks."  if  we 
substitute  "educational  tasks"  for  "tasks"  and  "knowledge  about 
Education"  for  "knowledge",  then  we  have  a  definition  of  the  field 
that  has  been  accepted  by  those  working  in  it  for  years. 

It  is  important  that  this  definition  implies  that  Educational 
Technology  is  a  process.  What  is  more,  it  is  a  decision-making 
process  that  Simon  (1981)  and  Glaser  (1976,  1985)  have  called 
"design".  It  is  certainly  not  a  theory,  as  AECT  (1977)  has  claimed 
If  for  no  other  reason  than  the  fact  that  processes,  while  guided  by 
theory  and  in  some  cases  even  producing  theory,  cannot  themselves  be 
theory.  (Whether  Educational  Technology  is  a  discipline  and  a  field, 
which  AECT  also  claimed,  is  debatable  but  beyond  the  scope  of  this 
discussion.) 

The  definition  points  to  how  theory  might  relate  to 
Educational  Technology.  Indeed,  theory  has  the  potential  for  fitting 
into  each  of  the  three  parts  of  the  definition.  "Systematic 
application"  is  not  itself  theory  and  instructional  development  is 
atheoretical.  Yet  it  is  conceivable  that  a  theory  might  be  developed 
that  explains  and  predicts  how  following  different  development 
procedures  could  lead  to  different  learning  outcomes.  Gerlach 
(1984),  for  one,  has  stated  that  research  that  might  lead  to  such  a 
theory  is  urgently  needed.  "Practical  educational  tasks"  are  not 
theory  either.  Yet  some  aspects  of  curriculum  theory,  aligned 
closely  with  Sociology  and  Political  Science,  do  explain  and  predict 
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how  the  practical  tasks  of  Education  are  identified  in  particular 
social  and  political  systems.  Yet  in  neither  of  these  cases  does 
theory  exist  that  Educational  Technology  can  point  to  as  its  own. 

„  ^r"         "scientific  and  other  organized  knowledge  about 
Education"  that  the  theory  that  drives  Educational  Technology  is  to 
be  found.  The  examination  of  the  definition  of  the  field,  which  is 
the  pupose  of  this  paper,  must  therefore  begin  with  a  clarification 
fc  r^t^  ^5®  theory  that  contains  this  knowledge  is,  for  it  is  here 
tiiat  the  foundations  of  the  field  must  lie.  As  we  shall  see,  once 
the  ttieoretical  foundation  of  the  field  has  been  acknowledged,  it 
will  be  necessary  to  rethink  certain  aspects  of  how  that  knowledge 
if  f^S  nature  of  the  practical  tasks 

that  Educational  Technology  is  best  fitted  to  address.  What  will 

*  narrower  conception  of  the  field,  but  one  that  is  more 
mcinageable,  more  viable,  more  respectable  and  more  unique. 

Theoretical  Foundation, 
fn„„H«JL„  °^  this  paper  that  the  main  theoretical 

.uSSoJJ  ?Mf°''        B^^^       cognitive  learning  theory,  in  order  to 
smpport  this  contention,  convincing  arguments  must  be  presented: 
^hil  Pfy°^°l09ical  theory  is  more  central  to  Educational  Technology 
than,  say,  system  theory  or  theories  of  management;  that  cognitive 
o5^?f«^^S«®  useful  than  behavioral  theories;  and  that  theories 

of  learning  are  more  fundamental  than  theories  of  instruction.  The 
case  for  each  of  these  is  progressively  harder  to  make.  But  it  can 
be  made  as  we  shall  see  in  the  followiiig  sections. 

The  need  for  Psychological  theory. 

The  "bottom  line"  of  Education  is  learning,  and  learning  is  a 
process.  This  is  so  obvious  that  it  seems  that  there 
if 4.^u    ^  5°^?*^-  are  those  who  argue  that  this  is 

nor  tne  case,  and  that  theories  of  management,  or  system  theory,  are 
really  what  Educational  Technology  should  be  founded  on  (see 
Heinich,  1984) .  Doubtless  such  theories  are  important  and  relevant. 
But  they  are  not  fundamental.  For  example,  a  major  purpose  of 

theories,  applied  to  education,  is  to  make  educational 
institutions  more  efficient,  which  is  fine  and  necessary.  But  the 
need  for  efficiency  in  educational  institutions  is  determined  in 

V®®*^  *°  help  students  learn.  Regardless  of  how  far  from 
students  one's  concerns  for  institutional  efficiency  are,  the 
students  are  always  there,  and  the  results  of  any  action  one  takes 
can  always  be  traced  when  all  is  said  and  done  to  a  student 
somewhere  attempting  to  learn  something. 

A  similar  argument  can  be  made  for  system  theory.  This 
mathematical  theory  of  the  behavior  of  complex  organisms 
(Bertalanffy,  1968)  has  been  thoroughly  misunderstood, 
misinterpreted  and  abused  by  a  great  many  educational  technologists. 
It  is  concerned  with  how  complexity  might  be  described  and 
controlled,  and  permits  us  to  consider  systems  as  wholes.  It  is  only 
secondarily  concerned  with  systematicity  in  decision-making,  or 
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design.  And  even  then,  we  have  grossly  oversimplified  the  basic 
theory.  In  fact,  the  majority  of  the  embodiments  of  "the  Systems 
Approach"  have  nothing  to  do  with  system  theory  at  all  and  are 
nothing  more  than  rather  fatuous  and  unsuccessful  attempts  on  the 
part  of  some  instructional  developers  to  make  their  work  appear  to 
be  theoretically  rigorous  (which  it  is  not) .  Davies  (1981) ,  Andrews 
and  Goodson  (1980)  and  others  have,  to  their  credit,  clearly 
spelled  out  the  difference  between  being  systemic  and  being 
systematic.  With  the  emphasis  on  being  systematic  rather  than 
systemic,  instructional  design  and  development  "models"  often 
appear  as  no  more  than  lists  of  steps  which,  if  performed  in  the 
correct  order,  might,  with  luck,  lead  to  instruction  that  is 
reasonably  effective,  such  a  conception  of  decision-making  is  so 
utterly  devoid  of  theory  that  to  call  it  an  application  of  system 
theory  is  quite  ridiculous. 

The  exception  proves  the  rule,  of  course.  In  those  cases  where 
educators  have  understood  system  theory,  it  has  proven  to  be  the 
powerful  tool  that  it  has  always  had  the  potential  of  being.  I  will 
give  three  examples.  The  first  is  the  work  of  Heinich  (1970,  1984) 
who  has  been  very  successful  in  drawing  to  our  attention  the  great 
complexity  of  educational  and  instructional  systems  and  how  the 
introduction  of  technology  into  the  educational  milieu  makes  these 
systems  even  more  complex.  Yet  Heinich "s  application  of  system 
theory  to  education  is  for  the  purpose  of  educational  and 
instructional  management,  which  is  to  say  it  is  at  least  one  step 
removed  from  the  student  who  is  trying  to  learn  something.  The 
"paradigm"  for  instructional  management  presented  in  the  1970 
monograph  describes  various  ways  in  which  technology  and  teachers 
might  fit  together  in  workable  ways  in  order  to  instruct.  But, 
?u  f^i'  ci  anything  about  the  nature  of  the  instruction 

that  might  be  designed  and  delivered.  (I  might  add  that  the  chapter 
on  learning  theory  is  the  least  successful  in  this  important  book). 

The  second  example  is  to  be  found  in  the  admittedly  difficult 
writings  of  Pask  (1975,  1984).  Pask's  "Conversation  Theory"  is 
something  of  an  offshoot  of  system  theory  in  that  it  is  largely 
concerned  with  mechanisms  of  feedback  and  other  cybernetic 
constructs  that  are  relevant  to  the  interaction  or  an  organism  with 
its  environment.  Pasks'  theory  is  nonetheless  concerned  with 
education  and  provides  an  ample  framework  within  which  to  explain 
how  the  learner,  as  a  system,  assimilates  new  knowledge  and 
accomodates  to  it. 

nQfi-7^^S»,??^^l®^^^}®  ^^L  Pef^^aP?  suprisingly,  the  work  of  Piaget 
ii  Piaget  is  not  primarily  thought  of  as  a  systems 

theorist,  there  are  nonetheless  many  echos  of  system  theory  in  his 
work.  (Like  Von  Bertalanffy,  he  was  a  biologist  by  training,  and 
they  certainly  knew  each  other) .  The  notions  of  assimilation  and 
accomodation,  which  are  fundamental  to  Piaget ian  theory,  are  more 
than  coincidentally  similar  to  catabolic  and  anabolic  processes  in 
living  organisms,  explained  by  system  theory.  Equilibrium  and 
homeostasis  are  to  all  intents  and  purposes  identical  constructs. 
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And  Piaget's  (1970)  book  Struc±urallsmr  little  read  by  educators, 
likewise  contains  laany  ideas  that  are  traceable  to  system  theory. 

Something  quite  fascinating  appears  when  you  consider  these 
examples.  First,  as  we  have  seen,  Keinich  does  not  apply  system 
theory  directly  to  instructional  decision-making.  We  therefore 
cannot  consider  it  to  be  fundamental.  Second,  in  the  work  of  Pask 
and  Piaget,  the  application  of  system  theory  to  education  takes 
^.ff®^^?  *  psychological  context.  Pask  and  Piaget  are  not  concerned 
with  being  systematic  while  doing  instructional  design,  nor  even 
with  instructional  strategies  and  methods,  but  with  the 
psychological  implications  of  looking  at  the  learner  as  a  complex 
cognitive  "organism".  Thus,  we  might  easily  conclude  that  when 
system  theory  is  properly  applied  to  education,  it  is  either  only 
indirectly  concerned  with  instruction  (as  with  instructional 
management,  for  example) ,  or  else  it  is  concerned  with  psychological 
issues.  Only  in  the  latter  case  is  it  directly  concerned  with  the 
learner. 

The  need  for  a  cocmitlve  emphasis. 

Doubtless,  those  psychological  theories  that  have  been  most 
successful  in  guiding  instructional  design  have  been  behavioral.  The 
work  of  Skinner  (1954),  for  example,  produced  a  descriptive  theory 
?n«ii^S?^«^       4®'^^"^?®''*??  conditioning",  a  prescriptive  theory  of 
i«S  r^??^  "4*^®^}^®?  directly  from  operant  conditioning,  techniques 
for  delivering  instruction  such  as  teaching  machines  and  programmed 
i2??f"°H°u'  *  philosophical  frame  of  reference  (Skinner, 

1971)  which  stressed  the  necessity  for  man  to  give  up  freedom  and 
dignity  in  order  to  survive.  The  whole  forms  a  package  whose 
???f;f^"w^^.***^,"°^  subsequently  been  matched.  Likewise,  cropper's 
(1983    behaviorally-based  instructional  theory  is  the  most  thorough 
of  all  of  those  presented  in  Reigeluth's  (1983)  compendium.  / 

However  complete,  thorough  and  practical  behavioral  theories 
Of  learning  and  instruction  might  be,  they  are  nonetheless  based  on 
an  inadequate  account  of  how  people  learn.  (As  we  shall  see,  the 
choice  we  have  to  make  in  our  field  is  whether  we  do  whal  we  do  well 
but  limit  our  effectiveness  to  only  a  few  aspects  of  instruction,  or 
whether  we  try  to  broaden  the  applicability  of  what  we  do  at  the 
risk  of  doing  it  less  well  for  the  moment.  Obviously,  I  have  opted 

f  ylie  latter) .  The  arguments  for  a  cognitive  approach  to  learning 
and  instruction  are  many,  convincing  and  largely  known.  They  range 
from  Koestler-s  (1967)  contention  that  there  are  emergent  ^ 
properties  of  human  thinking  that  be?.aviorism  cannot  explain,  to 
Neisser's  (1976)  account  of  the  importance  of  schemata  in 
determining  what  is  learned,  to  Wittrock's  (1979)  description  of 
learning  as  a  generative  process.  Shuell  (1986)  has  provided  a 
Oiorough  account  of  the  major  components  of  cognitive  learnina 
theories .  ^ 

Our  field  remains  wedded  to  its  behavioral  roots.  There  are 
two  reasons  for  this.  First,  historically,  the  field  found  its  feet 
during  the  heyday  of  Behaviorism  in  the  early  "fifties,  when 
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programmed  instruction  was  "all  the  rage".  Had  the  field  grown  up  in 
the  'twenties  dnd  'thirties,  alongside  Gestalt  psychology,  for 
example,  it  might  have  looked  very  different  today.  Second, 

design  as  we  have  come  to  know  it  can  only  flourish 
within  a  behavioral  context.  This  is  because  any  instruction  whose 
design  is  separated  in  time  from  its  implementation  can  only  ever 
present  information  as  stimuli  for  students  to  react  to.  students 
caimot  modify  the  program  of  instruction  (the  stimuli)  to  any  extent 
without  it  falling  to  pieces.  This  is  why  instruction  produced 
through  the  usual  design  process  is  most  successful  in  those 
situations  where  students  are  largely  passive  and  are  learning 
lower-level  skills  (in  the  Gagnean  sense),  that  is  to  say  in 
training  settings.  ^ 

When  one  acknowledges  that  students  are  capable  of  thinking 
for  themselves,  and  that  learning  occurs  when  someone  acts  upon 
information  rather  than  simply  reacting  to  it,  two  things  become 
clear.  The  first  is  that  instruction  has  to  be  sufficiently  flexible 
to  deal  with  all  of  the  things  that  happen  when  cognitively  active 
learners  engage  in  it  and  that  could  not  have  been  anticipated  by 
instructional  designers.  This  requires  that  some,  even  if  not  all  of 
the  instructional  decisions  must  be  made  in  interaction  with 
students  once  instruction  has  begun.  This  is  normally  taken  care  of 
when  a  good  teacher  delivers  the  instruction  (Nunan,  1983) .  The 
second  thing  that  becomes  clear  is  that  most  current  "models"  of 
instructional  design  are  largely  inappropriate  in  a  cognitive 
context.  This  is  because  they  require  that  all  instructional 
decisions  be  made,  and  tested,  before  instruction  is  implemented, 
and  that  they  leave  no  room  for  adaptation  once  instruction  has 
begun.  There  are,  of  course,  exceptions.  The  work  of  Greeno  (1980). 
Resnick  (1976)  and  others  has  given  rise  to  a  variety  of  cognitive 
H??o^?w  2"*^  design  procedures.  But  once  again,  these  have  emerged 
directly  from  psychological  theory  and  research  and  not  from 
educational  technology. 

It  is,  therefore,  only  when  instructional  decision-making 
occurs  during  instruction,  either  through  the  agency  of  a  good 
teacher  or  of  an  intelligent  tutoring  system,  that  it  is  possible 
for  instruction  to  follow  the  principles  of  cognitive  theories  of 
learning  and  instruction.  This  implies  a  new  role  for  instructional 
designers  (Winn,  1987) .  Rather  than  selecting  instructional  methods 

JIkJ^k^?!  outcomes  of  instruction  are  to  be  and  the  conditions 
under  which  it  is  to  occur,  designers  will  increasingly  be  concerned 
with  studying  how  such  decisions  are  made  and  with  building 
instructional  systems  that  are  capable  of  making  them. 

Theories  of  learning  and  of  instruetlon. 

The  final  stage  of  our  argument  requires  us  to  look  at 
descriptive  theories  of  learning  and  prescriptive  theories  of 
instruction.  As  Reigeluth  (1983)  has  pointed  out,  learning  theories 
are  not  necessarily  descriptive,  nor  are  instructional  theories 
necessarily  prescriptive.  But  for  our  purpose,  it  is  sufficient  to 
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distinguish  between  descriptive  theories  that  describe  what  happens 
when  someone  learns  something  and  prescriptive  theories  that  tell  us 
what  to  do  in  order  to  get  someone  to  learn  something.  The  argument 
is  that  descriptive  theories  are  more  fundamental  to  educational 
technology  than  prescriptive  theories  in  contrast  to  what  is 
currently  believed  to  be  the  case. 

The  first  point  to  make  is  that  descriptive  theory  precedes 
prescriptive  theory,  while  this  does  not  imply  that  descriptive 
theories  can  necessarily  be  simply  restated  in  prescriptive  form,  as 
Landa  (1983)  has  pointed  out,  it  does  suggest  that  we  have  to  be 
able  to  describe  something  before  we  can  determine  what  it  is  that 
we  havG  to  do  in  order  to  bring  that  something  about.  Behavioral 
theories  of  learning  and  instruction  are  perfect  examples  of  this. 
The  work  of  Pavlov,  Skinner  and  the  other  behaviorists  wss 
originally  descriptive.  It  described  and  explained  what  happened 
When  a  stimulus  was  presented  to  an  organism  under  various 
conditions.  Prescriptive  theory  was  only  possible  once  this 
explanatory  theory  had  been  well  developed. 

The  second  point  is  that  one  of  the  reasons  behavioral 
theories  of  instruction  are,  within  their  limitations,  so  complete 
is  that  they  are  built  from  what  is  known  about  the  conditions  that 
are  necessary  for  learning  to  take  place.  As  Clark  (1983) ,  among 
others,  has  pointed  out,  theories  of  instruction  fall  short  of 
satisfactory  if  they  merely  address  the  sufficient,  as  opposed  to 
the  necessary  conditions  of  learning.  Thus,  while  we  can  demonstrate 
that  giving  a  rat  an  electric  shock  may  be  sufficient  to  extinguish 
a  learned  behavior,  so  may  a  whole  host  of  other  negative 
reinforcers.  The  key  to  this  form  of  extinction  is  therefore  not  the. 
realization  that  an  electric  shock  extinguishes  learning  but  the 
more  general  theoretical  principle  of  negative  reinforcement.  This 
is  relatively  clear  in  the  case  of  behavioral  theories  as  these  are 
well  developed  and  complete. 

The  same  cannot  be  said  for  cognitive  theories.  Because  they 
have  to  account  for  far  more  complex  phenomena  than  behavioral 
?S°^Z?®' 5®°*"?®  research  aimed  at  developing  them  began  more 
recently  than  behavioral  research,  they  are  far  less  developed  and 
complete.  This  has  had  two  results.  The  first  is  that  prescriptive 
cognitive  theories  of  instruction,  such  as  they  are,  are  incomplete 
and  therefore  less  reliable  than  they  will  be.  Second,  instructional 
designers  have  been  tempted  to  derive  principles  from  the  bits  and 
pieces  of  cognitive  research  that  have  been  completed,  and  have 
relied,  often  xinwittingly,  on  what  is  known  about  the 
sufficient,  rather  than  necessary  conditions  of  learning.  This  not 
to  say  that  there  is  no  descriptive  cognitive  learning  theory.  The 
work  of  Neisser  (1976),  of  Rumelhart  and  Norman  (19S1)  and  many 
others  belies  that  assumption.  The  problem  stems  from  the  less 
complete  state  of  cognitive  theory  and  from  the  fact  that 
instructional  designers  by  and  large  do  not  know  the  difference 
between  sufficient  and  necessary  conditions.  The  prescriptions  for 
action  in  cognitive  theory  simply  do  not  exist  in  sufficiently 
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reliable  fora  for  them  to  be  useable. 

What  this  neans  is  that  descriptive  theories  of  learning  are. 

reliable  than  prescriptive  theories  of  instructioA 
within  the  cognitive  framework.  It  is  therefore  best  if 
instructional  designers  work  with  descriptive  theory  rather  than 
Sii?  incomplete  and  sometimes  misleading  prescriptive  principles. 
With  a  knowledge  of  how  people  learn,  the  designer  can  act  as  each 

circumstances  permits  and  at  the  jame  time  adapt  theory  to 
particular  needs  rather  than  blindly  following  "cookbook" 
prescriptions  for  instructional  design. 

^.       ^      ThgyrV-based  l.. struct ional  dea^mi. 

(1985)  has  criticized  the  instruction  students  in 
educe  ..ional  technology  programs  receive  for  teaching  techniques 
rath^v  than  principles.  Clark  (1978)  has,  likewise,  levelled 
S^H  }Si,^?l,*VJ?  programs  from  not  emphasizing  research 

and  jnquiiT-  Both  of  these  criticisms  are  justified.  If  students  are 
taught  that  instructional  design  is  a  simple  process  that  leads  tS 
effective  instruction  provided  that  the  instructions  in  each  box  in 
a  flowchart  are  carried  out  and  that  the  selection  of  instructional 
strategies  can  be  achieved  by  looking  them  up  in  a  table,  then  they 
have  been  taught  techniques  that  are  not  f ouSded  in  theoiy!  The^ 
^'i!*^  designer  trained  in  this  manner  can  "do"  instractional 
design  up  to  a  point,  provided  that  nothing  unforeseen  occurs.  But 
that  designer  cannot  reason  about  what  he  or  she  is  doing  and 
therefore  has  great  difficulty  transferring  the  design  skills 
iearn<»d  in  the  design  course  to  any  "real-world"  setting.  The 
designer  trained  in  this  way  is  at  a  particular  disadvantage  when  a 

^''J^i?"  ^J""  testing  of  instruction  Shose 

solutiwi  has  not  been  directly  addressed  in  the  design  course. 

When  one  looks  at  the  way  in  which  an  expert  in  any  field 
functions,  one  finds  that  they  do  not  simply  use  techniques  for- 
getting the  job  done,  schon  (1983,  1987)  has  characterized 

S^fSff^i?"*^.®'^®^?^*®  ability  to  carry  out  what  he  calls 

"reflection  in  action".  Reflection  in  action  is  nothing  more  nor 
less  than  the  ability  to  reason  about  problems  from  first 

?JiJ°;^i®"'4^°.°^"^^°^'  w^^^'  spontaneous  experiments 

that  are  guided  by  a  general  theoretical  framework  but  aimed  at 
SSSt^^J'S        usually  unforeseen  problems,  schon  documents  his  two 
books  Witt!  examples  from  a  number  of  professions.  In  each  case,  we 
see  expert  professionals  achieving  an  impressive  blending  of  theory 
with  practice  through  what  is  in  effect  spontaneous  research.  If 
?h^S*?J°"!^  Technology  is  indeed  a  profession,  this  is  a  standard 
that  it  should  emulate. 

What  might  instructional  design  look  like  given  schon 's 
SoSld^hi°?««  ^U^S^^K  T°  ^«9in  with,  the  emphasis  in  design  training 
^  J-^^f  ^"  techniques  and  more  on  the  acquisition  of  a  well- 

JS^?    4.?"°"^*^^?.^*^®-.^''^  ^«  accompanied  by  an  extensive 

"reflective  practicum"  in  which  the  student  woSld  be  apprenticed  to 
an  expert  designer  who  in  addition  to  being  good  at  design  would 
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also  be  good  at  helping  the  student  reflect  in  action.  In  other 
words,  the  designer  would  have  the  ability  to  nake  students  reason 
fron  first  principles  rather  ti\an  simply  helping  tnem  find  which 
techniques  to  apply. 

Once  hrjyond  training,  tt.e  instructional  designer  would  refer 
to  JcnowledC;    about  how  people  laam  in  order  to  draw  guidance  in 
instructional  decision-aaking.  The  advantage  of  this  would  be  that 
variations  in  the  context  in  which  instruction  is  to  be  designed 
would  cease  to  be  problematic.  The  designer  would  be  able  to 
function  at  a  level  of  generality  sufficient  to  transcend  the 
!S®S:54  4??^"^*  2£.*?*^  instructional  setting.  Theory,  ren«nber,  is 
L    £4         "  sufficiently  general  and  robust  to  be  valid  in  all 

?"!'4i^*.!?**        PJ^oP^J^y      ^emg  able  to  predict  what  will 
occur  even  if  the  circumstances  are  entirely  new. 

^  ^  comment,  it  is  quite  likely  that  before  long  computer- 

^'^^^  ^*  <*°^n5r  instructiont.i  design  (Merrill, 
fl'*    ZZ,^^  ^^^^  ^*  *  ^°"5r  time  before  computers  can  reflect  ia 
action.  This  eeans  that  computer-based  instructional  design  systems 
Itll  y*li^*      thm  "technique"  level  and  will  design  instruction 
that  continues  to  be  behaviorally  oriented,  predetermined  and 
incapable  of  all  but  the  crudest  of  adaptations  to  changing 

*       during  its  implementation.  Instiructional  designers  will 
still  be  needed  to  bring  their  knowledge  of  learning  theory  to 

««!-JJ!?!i°2JV''°^^'!!"  *"'*4??  'i^st  principles,  which  is 

something  that  computers  will  not  be  able  to  do  for  a  long  time. 

Conclusion 

.p-^»,««?«J**y®  the  foundation  of  the  field  of  Educational 

Technology  is  to  be  found  in  cognitive  theories  of  learning  and  we 
have  seen  how  this  might  change  the  way  in  which  instructional 
designers  ply  their  trade.  By  way  of  conclusion  we  shall  look  at  an 
important  implication  of  this  for  the  practice  of  the  field. 

4^».  ^poubtless  the  ideas  presented  so  far  will  not  go  down  well 
with  those  in  our  field  with  a  more  "practical"  bent.  The  history  of 
?Sf  reveals  that  there  has  always  been  opposition  within 

u    *.f,?i**  theory  that  has  at  times  bordered  on 

hostility,  jniis  is  to  be  expected.  Educational  practitioners  are 
handicapped  by  all  manner  of  constraints  that  make  it  difficult  for 
them  to  operate  from  first  principles.  They  have  little  time  for 
decision-making  themselves  and  there  are  few  incentives  for  them  to 
be  innovative.  They  have  in  all  likelihood  been  trained  in  the  first 
^JSr^         wphasizes  techniques  rathes:  than  theory  and 
principles.  And  their  orientation  is  probably  behaviora?..  They  are 
therefore  probably  not  only  unwilling  but  also  unable  to  reflect  in 
action  in  order  to  make  instructional  decisions. 
4^  p^,i!*.f°^  no  other  reasons  than  these,  it  can  be  concluded  that 

S  Technology  is  to  survive,  develop  and  thrive,  then  it 

must  do  so  outside  the  traditional  structures  and  institutions  of 
Education.  This  is  an  argument  that  Heinich  (1984)  has  made  already, 
and  the  reader  is  referred  to  his  insightful  and  prevocacive 
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article.  It  is  worth  noting  that,  in  the  estimation  of  many,  some  of 
the  most  successful  applications  of  Educational  Technology  have 
indeed  occurred  outside  these  traditional  structures  (Britain's 
Open  University  comes  immediately  to  mind) .  It  is  also  worthy  of 
note  that  these  successes  have  occurred  without  heavy  reliance  on 
the  "techniques"  of  instructional  design  that  are  taught  in  most  of 
our  graduate  programs. 

The  other  side  of  the  coin  is  that  traditional  institutions 
are  doing  just  fine  and  have  no  need  for  Educational  Technology 
(Nunan,  1983) .  This  should  not  be  taken  as  a  condemnation  of  the 
field  but  as  further  evidence  that  it  is  more  likely  to  succeed 
elsewhere.  Training  and  any  situation  where  the  student  interacts 
directly  with  instruction  without  the  mediation  of  a  teacher  are 
examples  of  situations  in  which  instructional  design  has  an 
important  role  to  play. 

We  began  with  the  idea  that  the  field  and  the  Association  are 
t^ing  to  go  in  all  directions  at  once  and  are,  as  a  consequence, 
not  going  anywhere  at  all.  It  is  hoped  that  the  arguments  put 
forward  above  will  at  least  be  considered  by  Educational 
Technologists  and  that,  founded  on  cognitive  theories  of  learning, 
the  field  can  advance  to  the  status  of  a  true  profession  whose 
members  eschew  techniques  in  favor  of  reasoning  from  first 

mastery  of  this  approach  to  the  discipline  can  be 
demonstrated,  it  is  quite  likely  that  we  will  be  invited  to 
contribute  in  a  major  fashion  to  the  reforms  of  American  education 
tnat  are  bound  to  occur  within  the  next  few  years. 
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The  Fishbeh  and  Ajzen  model  of  attitude-behavior  consistency  was  applied  to 
56  undergraduates  learning  to  use  a  microcomputer.  Two  levels  of  context  for 
this  act  were  compared:  the  students*  beliefs  about  themselves  arid  their  beliefs 
about  people  in  general.  The  results  indicated  that  students'  beliefs  were  good 
predictors  of  their  behavioral  intentions  and  they  thought  that  learning  to  use  a 
microcomputer  would  be  significantly  more  helpful  to  them  than  to  other  people. 
The  findings  are  congruent  with  the  Fishbein  ami  Ajzen  model  of  attitude-behavior 
consistency.  Examining  attitudinal  and  normative  beliefs  about  specific  behaviors 
provides  useful  information  on  learning  and  technology. 


Introduction 

Research  on  human-computer  interaction 
(HCI)  has  emphasized  ease  of  use  but  under- 
standing successfiil  interaction  means  discover- 
ing what  human  characteristics  are  involved  in 
leaniing  to  use  (National  Research  Council, 
1 983,  p,  114).  Educational  researchers  investi- 
gating the  issue  of  learner  attitudes  towards 
mdcrocomputers  have  tended  to  concentrate  on 
computer  anxiety,  a  sin^e  dimension  of  a 
multidimensional  attitude,  and  their  instruments 
range  fiom  semantic  differential  scales  (Wil- 
liams, Coulombe  &  Lievrow,  1983)  to  self- 
constracted  Likert  scales  (Maurer  &  Simonson, 
1984).  This  one  dimension  of  affect  must  be 
distrusted  (Cambrc  &  Cook,  1985;  Howard  & 
Smith,  1986).  Beyond  intuitive  opinions  of 
computer  anxiety,  such  as  those  presented  by 
Schneiderman  (1986,  p.  426),  there  needs  to  be 
better  understanding  of  learner  attitucfes  so  that 
assumptions  on  the  part  of  instructors  do  not 
prejudice  the  opportunities  of  students  to  learn. 


Fishbein  and  Ajzen's  model  of  attitude-behavior 
consistency  (Fishbein  &  Ajzen,  1975;  Ajzen  & 
Hshbein,  1980)  can  contribute  to  better  under- 
standing of  attitudes  and  be  more  meaningful 
towards  predicting  behavior  (Travers,  1982, 
p.  393).  In  conducting  the  investigation  reported 
here  a  philosophical  stance  was  invoked  horn 
the  Fishbein  and  Ajzen  theory  of  reasoned 
action:  learning,  as  a  behavior,  is  to  some 
degree  volitional  and  guided  by  the  behavioral 
intent  of  the  individu^. 


Background 

Fishbein  uses  attitude  to  refer  to  "a  learned 
predisposition  to  respond  to  any  object  in  a 
consistentiy  favorable  or  unfavorable  way" 
(1967,  p.  477).  Evaluative  beliefs  about  an 
object  and  the  strength  of  those  beliefs  function 
together  as  the  basis  for  predicting  an 
individual's  attitude  and  is  expressed  by  this 
algebraic  figure  (Fishbein  &  Ajzen,  1975): 
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B-BI  =  [I  B.E]W,  +  [INBMCJW, 


i=l 


i=l 


The  first  half  of  the  equation  describes  the 
attitude  towards  the  behavior  in  question.  Overt 
behavior  (B)  and  the  intent  to  perform  that 
behavior  (BI)  are  a  function  of  beliefs  (fi)  about 
that  behavior  leading  to  consequences.  The 
evaluation  of  those  consequences  is  E.  and 
indicates  the  strength  of  those  beliefs. ' 

The  logic  of  the  second  part  of  the  formula 
runs  parallel.  It  describes  the  influence  of  other 
people  on  the  actor's  normative  beliefs  and  how 
much  the  actor  is  likely  to  accede  to  them  in 
general.  The  normative  belief,  as  perceived 
expectation  of  referent  i  (  NB.),  is  multiplied  by 
the  motivation  to  comply  witA  referent  i  ( MC^. 
The  two  components  of  the  formula  are  empiri- 
cally weighted  relative  to  intentions  by  regres- 
sion ( and  W^). 

Hypotheses 

The  purpose  of  this  study  was  to  discover  the 
relationships  of  beliefs  to  behavioral  intent  for 
people  learning  to  use  microcomputers.  It  was 
hypothesized  tiliat  die  beliefs  of  learners  would 
correlate  significantly  with  their  behavioral 
intentions.  This  would  test  the  Bshbein  and 
Ajzen  model  of  attitude-behavior  consistency  in 
the  context  of  learning.  The  particular  act, 
learning  to  use  a  microcomputer,  is  an  area  of 
recent  research  interest  in  education  ( Salomon 
&  Gardner,  1986). 

As  a  further  test  of  the  applicability  of  the 
model  two  levels  of  instructional  context  were 
investigated,  specific  and  the  global.  The  model 
could  be  refined  relevant  to  learning  by  demon- 
strating that  generality  in  context  elements 


decreases  the  predictive  validity  of  attitude 
measurement  towards  a  specific  target.  A 
second  hypothesis  was  generated  and  students 
were  asked  to  report  not  only  their  beliefs  about 
their  learning  to  use  a  microcomputer  but  also 
their  beliefs  about  people  in  general  learning  to 
use  a  microcomputer.  It  was  hypothesized  tiiat 
the  beliefs  of  learners  about  otiier  people 
learning  to  use  microcomputers  would  be 
significantly  weaker  than  their  beliefs  about 
themselves  learning  to  use  microcomputers. 


Method 

Respondents  were  56  undergraduates 
attending  a  state  imiversity  campus. 

Measurement  and  Procedures 

The  contents  of  the  predictive  components 
of  the  questionnaire  were  based  on  expert 
knowledge  of  the  population  and  fitted  the 
categories  of  the  Fishbein  and  Ajzen  model. 
Students  had  been  observed  and  interviewed  the 
previous  semester  for  two  ergonomic  studies 
(Yeaman,  1985, 1986).  Computer  anxiety  did 
not  emerge  as  a  salient  belief  for  this  popula- 
tion. 

The  students  were  asked  to  rate  attitude 
statements  on  seven-point  adjective  bipolar 
scales.  The  questionnaires  were  given  on  the 
Grst  day  of  the  semester  as  ihc  initial  class 
activity  and  took  five  to  seven  minutes  to 
complete.  Prior  to  data  analysis  these  bipolar 
scales  were  scored  from  plus  three  to  minus 
three. 
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Results 

Correlations  above  .8  indicated  the  data  on 
the  attitudes  towards  the  act  of  learning  to  use  a 
microcomputer  were  reliable  and  consistent  A 
lack  of  significant  correspondence  between  the 
normative  aspect  and  the  behavioral  intentions 
was  anomalous  but  Fishbein  and  Ajzen's  model 
of  attitude-behavior  consistency,  as  the  theoreti- 
cal base  of  this  study,  does  not  allow  the  Influ- 
ence of  any  component,  though  nonsignificant, 
to  be  discounted  (Fishbein  &  Ajzen,  1976),  The 
equation  was  computed  for  each  level  of  con* 
text  The  students'  beliefs  about  themselves 
significantly  correlated  with  the  sum  of  behav- 
ioral intentions,  £<0OL  The  students  beliefs 
about  other  people  also  significantiy  correlated 
with  the  sum  of  behavioral  intentions,  2<.0L 
These  results  provided  further  support  for  the 
first  hypothesis  that  the  beliefs  of  leamers 
would  correlate  significantly  with  their  behav- 
ioral intentions. 

To  test  the  second  hypothesis  a  comparison 
was  made  between  the  student  beliefs  about 
their  own  behavior  and  their  beliefs  about  other 
people's  behavior*  A  t  test  showed  iht  personal 
beliefs  were  significantly  higher  (M  =  749)  than 
the  people  in  general  beliefs  (M  =  6.86),  J(54)  = 
-2.11,  ii<05.  This  supported  the  second  hy- 
pothesis, that  the  beliefs  of  leamers  about  other 
people  learning  to  use  microcomputers  are 
significantly  weaker  than  their  beliefs  about 
themselves  learning  to  use  microcomputers. 

Discussion 

Student  beliefs  and  behavioral  intent 

The  students'  beliefs  were  good  predictors 
of  their  intent  to  behave,  showing  the  Fishbein 
and  Ajzen  model  woriced  well  and  supporting 
the  first  hypothesis.  Scmtiny  of  the  raw  data  in- 
dicated that,  contrary  to  expectations,  normative 
items  were  not  always  scored  on  the  positive 
side  of  the  scale.  A  negative  normative  relation- 
ship between  wanting  to  comply  and  behavioral 
mtention  was  also  found  by  Waster  (1986). 
The  convergence  between  this  investigation  and 
Walster's  suggests  the  influences  of  norms  on 


leamers  and  their  motivation  to  comply  with 
them  could  be  an  important  area  of  investigation 
for  research  on  learning  and  HCI. 

The  specificitv  of  stodent  beliefs 

The  students  believed  that  learning  to  use  a 
microcomputer  would  be  significantly  more 
helpful  to  them  than  to  people  in  general.  This 
particular  fincUng  augments  the  Fishbein  and 
Ajzen  model  of  attitude-behavior  consistency  by 
demonstrating  that  the  predictive  validity  of 
attitude  measurement  towards  a  specific  target  is 
decreased  by  generality  in  instmctional  context. 

Conclusion 

The  relationship  of  learners'  attitudes  to 
their  learning  behavior  is  often  mistaken  as  a 
common  sense  issue  and  further  empirical 
investigations  are  recommended.  Evidence  from 
theory-based  research  can  provide  better  under- 
standing. Examining  attitudinal  and  normative 
beliefs,  as  related  to  specific  behaviors,  shows 
efficacy  relative  to  the  instructional  aspects  of 
HCI. 
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Intrcxiuction 


The  purpose  of  this  paper  is  to  describe  the  development 
of  a  conceptual  framework  for  conducting  research  using 
computer  based  interactive  video  (CBIV)  and  a  generic  disc  as 
research  tools.     In  1977,  Schramm  advocated  that  '^learning 
from  the  media... is  an  extremely  complex  multivariate  process 
that  challenges  us,  if  we  are  to  understand  it,  not  to  ask 
the  simple  questions,  but  rather  to  concern  ourselves  with 
the  conditions  for  selecting  one  medium  over  another,  for 
combining  and  for  using  media^  (in  Johnston,  1987,  p.  3.). 
With  the  technological  advances  which  converted  interactive 
video  to  computer  driven  interactive  video,  it  became  obvious 
in  the  early  eighties  that  designing  instruction  for  this 
medium  was  much  more  complex  since  more  variables  could  be 
called  upon  and  combined  to  create  a  learning  task.  What 
became  important,  then,  was  the  identification  of,  and 
theory-driven  specification  for,  using  those  multivariate 
factors  available  within  this  more  complex  and  powerful 
medium. 

The  Original  Research  Agenda 

After  analyzing  the  components  of  eight  models 
presenting  wholistic  conceptions  of  student  learning  in 
classroom  settings  that  were  summarized  by  Hartel,  Walberg, 
and  Weinstein  (1983),  Glaser*s  model  was  selected.  Glaser 
(1976)  suggests  that  the  design  of  instruction  must  account 
for  the  following  four  components: 

o  knowledge  and  skills  required  for  performance, 
o  initial  state  of  the  learner, 

o  conditions  to  change  the  learner  from  an  initial 

state  to  a  state  of  competence,  and 
o  short  and  long  term  outcomes  of  instruction. 

Siegel  and  Siegel  (1964)  suggest  that  a  framework  serves 
as  an  instructional  gestalt  whose  "special  virtue  is  derived 
from  the  fact  that  the  framework  calls  attention  to,  rather 
than  ignores  or  minimizes  the  importance  of,  the  complex 
nature  of  the  educational  process.     It  focuses  research 
interest  upon  variables  of  interaction  rather  than  upon  the 
main  effects'*  (p.  39).     Following  this  suggestion,  Grabowski 
and  Whitney  (1984)  reconfigured  the  four  components  suggested 
by  Glaser  into  a  3  dimensional  matrix  to  function  as  the 
overall  unifying  conceptual  framework  to  study  learning  with 
this  medium.    The  three  interacting  dimensions  consisted  of 
the  learner  (aptitude,  prior  experiences,  motivation, 
cognitive  style,/  cognitive  schema )/content  (the  content  area 
and  the  level  and  type  of  objectives  to  be 
achieved)/instructional  process  (instructional,  sequencing, 
and  presentational  strategies)  with  their  interactions 
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affecting  long  and  short  term  outcome*    Overlying  this  matrix 
were  media  attribute  choices  (modalities,  layout,  flow, 
color,  timing,  volume,  realism)  available  with  tho  computer 
based  interactive  video  medium  which  could  then  be  selected 
for  a  specific  type  of  learner,  for  a  specific  content  area 
and  outcome,  using  a  specific  strategy*    Their  goal  was  to 
use  the  framework  to  summarize  current  research  results  and 
identify  gaps  in  that  research  with  the  final  intent  of 
developing  prescriptions  which  link  theory  to  the  practice  of 
selecting  media  attributes  for  CBIV* 

At  the  same  time,  however,  Clark  (1983)  joined  other 
researchers  to  caution  even  more  emphatically  against 
conducting,  or  even  advocating,  more  inappropriate  media 
comparison  research*    His  cautionary  advice  was  also  levied 
against  this  proposed  framework*    The  intent  of  the 
conceptual  framework,  however,  was  NOT  to  focus  on  media,  but 
rather  on  media  attributes  or  the  forms  of  instruction* 
Resolving  whether  this  framework  fell  under  inappropriate 
media  research  became  extremely  important  before  further  work 
on  the  model  was  conducted*    The  resolution  of  this  problem 
lies  in  exploring  whether  CBIV  is,  indeed,  a  unique  delivery 
system  and  clarifying  what  type  of  variables  do  impact  upon 
••instructional  effectiveness*" 

The  Appropriateness  of  CBIV  Research 

Viewing  CBIV  (unlike  interactive  vicieo  which  lacks 
computer  control)  as  one  discrete  medium  is  somewhat 
problematic*     In  some  respects,  even  the  term  •'CBIV*'  is 
inappropriate  itself  since  it  defines  the  technology  in  terms 
of  only  two  media  —  video  and  computer*    CBIV  is,  in  fact, 
an  amalgam  of  many  media  connected  and  controlled  by  a 
computer,  and  thus,  represents  the  beginnings  of  a  truly 
••computer  based^^  learning  system  (CBLS)  which  will  continue 
to  evolve  for  many  years  to  come*    Advances  in  communication 
technology  have  already  begun  to  blur  the  distinctions 
between  a  number  of  delivery  systems  such  as  videotext, 
computer  based  learning  and  interactive  video*    Viewing  CBIV 
within  the  larger  context  of  a  computer-based  learning  system 
is  more  realistic*     Such  a  multif aceted,  flexible  and  unique 
delivery  system  can  have  important  implications  for 
instructional  research  and  instructional  development* 

First,  a  CBLS  will  allow  the  learner  to  direct  the 
interaction  with  the  instruction  to  a  much  greater  extent  and 
perhaps  even  to  the  point  where  the  learner  will  generate 
his/her  own  goals  and  objectives*    As  Salomon  (1986)  suggests 
this  technology  will  allow  instruction  to  become  increasingly 
self-guided,  open-ended,  and  interactive*    Therefore,  learner 
variables  such  as  attitude,  previous  knowledge,  learning 
style  will  become  increasingly  important  for  instructional 
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researchers  to  investigate*    Second ^  a  CBLS  system  will 
conceivably  allow  instruction  to  take  any  form  imaginable* 
Questions  related  to  what  delivery  mode  to  use  and  how 
messages  should  be  represented  on  a  particular  delivery  mode 
suddenly  become  very  important*  Unfortunately, 
instructional  design  models  afford  the  instructional 
developer  relatively  little  guidance  with  regard  to  questions 
posed  by  learner  characteristics  or  message  design* 

This  argument  leads  into  the  the  second  issue  which 
involves  the  clarification  of  the  types  of  variables  that 
impact  upon  ^instructional  effectiveness*^    Th;i  contention 
(Clark,  1983)  that  instructional  design  —  the  selection  of 
theory-based  strategies  that  are  intended  to  solve  a 
peirticular  instructional  problem  —  is  the  most  important 
activity  in  the  development  process  needs  to  be  examined  more 
fully*    Typically,  instructional  developers  never  work  from 
designs  that  stipulate  all  aspects  of  a  finished 
instructional  product*    In  fact.  Instructional  designs  a^re 
typically  lists  of  strategy  components  that  are  deemed 
appropriate  given  a  particular  learning  context  (Reigeluth, 
1983)*    For  example,  a  design  for  a  lesson  that  teaches 
students  to  classify  animals  as  mammals  might  include  a 
generality,  a  series  of  matched  examples  and  non-examples,  a 
sequence  of  examples  that  progresnes  from  simple  to  complex, 
practice  in  classifying,  and  learner  feedback*  Reigeluth 
(1983)  refers  to  such  design  documents  as  '^blueprints*'  and 
describes  the  role       the  instructional  designer  as  akin  to 
that  of  an  architect* 

The  blueprint/architect  is  a  bit  misleading  as  it 
suggests  a  greater  degree  of  fidelity  between  plan  ar i 
finished  product  than  actually  exists*    An  obvious  question 
emerges:    what  remains  to  be  st^.pulated  in  addition  to  the 
strategy  components  listed  in  an  instructional  blueprint?  If 
we  follow  the  blueprint  analogy  (such  as  a  blueprint  of  a 
house)  a  bit  further,  it  is  readily  apparent  that  a  great 
deal  remains  to  be  specified*    The  house  plan  is  incomplete 
in  a  number  of  ways*    The  plan  does  not  specify  how  the  rooms 
should  be  finished  —  what  color,  shade  and  texture  of  floor, 
wall  and  ceiling  coverings  to  use*    The  plan  does  not  specify 
what  furniture  to  buy  and  where  it  should       placed*  In 
short,  our  house  plan  merely  lays  out  a  shell*  Other 
specifications  need  to  be  made  in  order  to  mak    uhe  shell  a 
useful  and  enjoyable  place  to  live*     In  instructional  terms, 
an  instructional  design  does  not  even  result  in  something  as 
complete  as  the  empty  shell  of  a  finished  house*    The  major 
structural  components  of  the  lesson  are  in  place  but  the 
components  need  much  embellishment  in  order  to  yield  an 
instructional  product  that  will  be  effective  and  enjoyable 
for  the  learner*     In  essence,  the  blueprint  prescribes  the 
structure  of  the  lesson  but  it  does  not  prescribe  t.  ••form*' 
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the  lesson  should  take* 


The  instructional  designer  faces  a  myriad  of  questions 
related  to  the  form  of  the  finished  instructional  product. 
Instead  of  plaster  and  bricks ^  the  instructional  designer 
molds  and  crafts  information  into  meaningful ^  effective  and 
pleasing  messages  —  messages  that  contain  both  instructional 
content  and  instructional  strategies*     It  is  during  this 
process  of  message  design  that  life  is  breathed  into 
instructional  content  and  strategies  so  that  a  useful  product 
results.    The  developer  must  not  only  decide  what  attributes 
to  select  but  how  the  attributes  are  to  be  used*  The 
instructional  developer's  job  is  further  complicated  when 
working  with  CBLS.    One's  choices  are  nearly  unlimited. 
Errors  at  this  stage  —  such  as  poor  screen  layout  —  result 
in  a  muddledf  confusing  and  unappealing  product  and 
instructional  design  models  offer  very  little  guidance. 

What  is  interesting  about  this  discussion  is  that  if  the 
media  attributes  guidelines  are  stripped  away^  what  remains 
is  a  two  dimensional  matrix  of  learner  characteristics  and 
content  with  the  prescriptions  being  instructional 
strategies.    This  approach  ignores  the  important  prescriptive 
research  of  Chu  and  Schramm  (1968),  Fleming  and  Levie  (1978), 
Winn  (1987),  Dwyer  (1978),  and  Jonassen  (1982)  to  name  only  a 
few.    Research  questions  regarding  form  are  vital  to  ask 
because  of  their  perceived  impact  upon  the  "effectiveness"  of 
instruction  just  as  the  form  of  a  house  will  impact  on 
quality  of  life.    The  questions  regarding  content  and 
instructional  strategies  are  important  and  necessary,  but  not 
sufficient  as  Kozma  (1987)  states  in  a  recent  discussion  of 
this  issue.    Given  that  questions  regarding  the  form  of  the 
message  for  various  learner  characteristics  are  legitimate  to 
ask  and  that  their  answers  would  contribute  to  more 
"effective"  instruction  as  this  paper  argues,  guidelines  are 
necessary,  and  research  is  needed  to  help  formulate  and 
validate  them.    The  conceptual  framework  for  CDLS  and  the 
CBLS  itself  are  powerful  tools  for  accomplishing  just  that. 

The  important  and  unique  aspects  of  CBLS  which  make  it  a 
powerful  tool  for  formulating  those  guidelines  and  conducting 
this  research  are  important  to  highlight.    The  CBLS 
technology  offers  a  means  for  carefully  studying  many 
instructional  and  media  attributes  acting  in  unison,  and  the 
means  to  "control  for"  the  effects  of  specific  attributes. 
The  implications  for  research  are  numerous.     For  example,  a 
CBLS  unit  could  act  as  "both  stimulus  material  and  data 
collection  device"  (Chen,  1986,  p.  27).     In  addition,  the 
research  control  afforded  by  CBLS  would  reduce  the  likelihood 
of  introducing  confounding  variables  and  would  ease 
replication  in  various  settings. 
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Therefore f  the  CBLS  described  here  is  indeed  something 
neWf  cannot  be  described  as  one  distinct  medium  to  be 
compared  with  others ^  and  the  form  available/unique  to  it 
warrants  further  study.    The  technology's  ability  to  "abolish 
previous  media  distinctions"  (Chen,  1986,  p.  27)  and  to 
afford  a  high  level  of  interactivity  is  unique.    At  the  same 
time,  the  nature  of  a  CBLS  will  force  and  enable  researchers 
to  examine  issues  related  to  learner  characteristics  and 
message  form  more  closely  and  within  a  more  controlled 
environment. 

The  Revised  Agenda 

Given,  then,  that  CBLS  message  design  research  is 
appropriate  as  described,  an  altered  version  of  the  1984 
Grabowski  and  Whitney  conceptual  framework  was  developed  to 
guide  our  latest  thinking  regarding  the  interaction  of 
accountab"^3  components  of  instruction.    This  new  framework 
includes  iearner  characteristics,  content  type,  message 
design,  and  instructional  strategies  as  the  important 
variables  which  affect  affective  and  cognitive  outcomes.  (See 
Figure  1).    As  can  be  noted,  learner,  content,  and 
instructional  process  variables  are  still  reflected  in  this 
framework,  however,  the  use  of  a  branched  flowchart  rather 
than  a  matrix  and  the  inclusion  of  message  design  as  a 
discrete  step  rather  than  being  overlaid  onto  the  entire 
model  mark  the  dif f erenceis.    This  strategy  more  clearly 
reflects  the  decision  process  of  instructional  developers  and 
will  also  facilitate  the  creation  of  an  expert  system  to 
manage  the  subsequent  development  prescriptions,  i.e.  given  a 
specific  content  type  and  instructional  strategy,  and  most 
important  learner  characteristics  which  must  be  taken  into 
account,  message  design  principles  would  be  selected. 


Insert  Figure  One  here. 


As  described  earlier,  instructional  design  models 
currently  offer  much  guidance  to  designers  for  selecting 
instructional  strategies  for  specific  content  and  outcomes 
and  are  well  researched.    These  two  components  are  included 
in  the  framework  because  they  are  necessary  elements,  but 
will  not  be  included  specifically  in  this  round  of  research 
queistions.    Therefore,  content  type  and  instructional 
strategy  will  be  givens  in  the  model  and  will  not  be  varied. 
Learner  characteristics  continues  to  be  the  key  component  and 
remains  at  the  core  of  the  model  with  the  other  key  feature 
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being  message  design  variables*  The  purpose  of  the  research 
agenda  is  to  identify  those  learner  characteristics  for  which 
message  design  can  have  a  major  impact.  Variations  in  learner 
characteristics  will  be  matched  and  varied  with  message  forms 
to  determine  which  of  the  many  learner  characteristics  should 
be  taken  into  account  when  developing  an  instructional 
message. 

Using  this  structure,  a  select  list  of  learner 
characteristics  and  message  design  were  chosen  for  their 
potential  for  exploring  the  unique  aspects  of  ^the  computer 
based  learning  system.    Three  categories  are  included  under 
learner  characteristics: 

o  the  structure  of  memory, 
o  cognitive  style,  and 
o  modality  preferences, 

Under  each  of  these  broad  categories  of  learner 
characteristics,  specific  characteristics  of  special  interest 
were  selected: 

o  characteristics  of  the  structure  of  memory 
-cognitive  engagement 
-cognitive  schema  matching 

o  cognitive  style  variables 

-field  dependence/independence 

-organization  of  information 
- (serial istic/wholi Stic , 

-  detailed/global) 
-social/human  aspects 

o  modalicy  strength  of  learning, 
-message  representation 

-(static  visual,  auditory, 

-  dynamic,  manipulative  visuals) 

Careful  reflection  of  the  special  representational  strengths 
of  the  CBL  medium  prompted  the  selection  of  5  important 
variables: 

o  interactivity, 

o  easily  accessed  massive  text  and  visual  data  bases, 

o  graphic  overlay, 

o  video  windows,  and 

o  alternate  visual  and  audio  forms. 

Five  areas  of  inquiry  evolved  from  interrelating  these 
learner  characteristics  and  message  design  variables  of  the 
CBLS,  and  will  be  described  next. 
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Interactivity  and  cognitive  engagements    The  interactive 
nature  of  the  CBLS  is  a  naturally  powerful  medium  for 
cognitive  engagement*    Cognitive  engagement  entaiis  much  more 
that  merely    controlling  pace  and  sequence*     It  assumes  an 
active  involvement  of  all  stages  of  the  memory,  with  special 
emphasis  on  the  working  memory*    Through  the  working  memory, 
students  relate  stimuli  from  the  environment  to  information 
in  long  term  memory ,  and  are  mentally  active  during  this 
process*    Simply  controlling  the  pace  of  a  lesson  (press 
return  to  continue)  or  the  sequence  does  not  activate  that 
extremely  important  activity  of  interacting  with  the 
material*    While  Hannafin  et*al*  (1985,  1986),  Gay  (1986), 
Carrier,  (1985)  and  others  are  actively  researching  various 
aspects  of  learner  control,  this  agenda  will  seek  to  explore 
the  •'transactional''  (Merrill,  1985)  effects  of  "dialoguing" 
with  the  system*    The  additional  representational 
capabilities  of  the  system  extend  the  research  from  dialogue 
with  computer  generated  text  and  animation  to  a  dialogue  with 
full  audio  and  video  fidelity  from  the  videodisc*     This  leads 
to  the  following  research  question: 

o  What  effect  will  cognitive  engagement  through 

instructional  transactions  with  the  full  audio  and 
video  fidelity  have  on  learning? 


Text  and  visual  data  bases  and  cognitive  schema*  The 
main  strength  of  the  CBLS  is  its  extensive  storage  capacity 
of  both  high  fidelity  audio  and  video,  and  computer  data*  The 
power  of  the  system,  however,  lies  in  its  computing  capacity 
to  manipulate  the  extensive  stored  data*  These 
characteristics  make  it  more  feasible  to  research  cognitive 
schema  matching  than  it  ever  was  before*    Tapping  in  on  the 
higher  level  information  processing  capabilities  of  the 
learner  through  assimilation  and  accommodation  should  result 
in  a  deeper  understanding  of  the  instruction*    By  first 
identifying  the  learner's  organizational  representation  of 
the  content  in  his/her  own  mind,  two  strategies  can  be 
explored*    The  first  is  to  tie  the  new  information  to  the 
existing  patterns  of  thought  in  the  learner*    The  second  is 
to  try  to  alter  the  patterns  of  thought  to  that  of  the 
"expert*"    In  either  case,  visual  or  textual  display  can  be 
manipulated  by  information  from  the  original  schema  of  the 
learner*    Research  questions  specific  to  this  topic  include: 

o  What  effect  will  matching  existing  cognitive  schema 
with  visual  and  textual  data  base  information 
(reflecting  either  the  expert  or  novice  organization 
of  information  in  the  lesson)  have  on  deep  processing? 

Graphic  overlay  and  field  dependence/independence*  With 
graphic  overlay  capability,  highly  dense  visual  information 
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can  be  simplified ,  and  very  simple  displays  can  be  enhanced 
with  the  more  realistic,  dense  visuals.    This  capability  of 
manipulating  the  perceptual  displays  enables  researcher  to 
explore  more  fully  the  cognitive  processing  of  field 
dependent  and  field  independent  learners.    As  Travers  (1982) 
so  aptly  states,  •'The  difference  between  the  field-dependent 
and  the  field-independent  person  is  particularly  marked  with 
respect  to  what  is  looked  at  and  seen**  (p.  75).     Since  field 
dependent  and  field  independent  learners  process  information 
either  though  global  or  detailed  perspectives,  the  message 
form  in  terms  of  highlighting  and  sequencing'  of  the  density 
of  the  visual  display  could  be  manipulated  to  match  their 
style  of  thinking.    As  a  result,  researchers  can  explore  more 
fully  the  interaction  of  this  cognitive  style  and  display 
types.  The  following  research  questions  are  of  interest: 

o  What  effect  does  using  graphic  overlay  have  on 

learning  for  field  dependent  and  independent  learners? 

o  What  effect  does  altering  the  sequencing  of  the 

display  type  have  on  learning  for  field  dependent  and 
independent  learners? 

Video  windows  and  field  dependence/independence.  With 
the  CBLS  system,  both  video  and  text  information  can  be 
displayed  on  the  screen  at  the  same  time.    Full  motion  video 
and  audio  can  be  played  concurrently  with  the  printed  text 
from  the  computer.    This  capability  offers  great  flexibility 
in  the  design  of  screen  displays,  but  one  area  of  relevance 
to  this  research  agenda  is  its  ability  to  display  talking 
faces  at  the  scime  time  as  text.    While  that  may  seem  to  be  an 
inappropriate  combination,  given  that  another  perceptual 
difference  between  field  dependent  and  independent  learners 
is  their  attention  to  people  and  faces,  it  follows  that  the 
addition  of  a  more  •'human  element**  to  the  not-so-human 
computer  environment  may  increase  learning  by  field  dependent 
learners/  while  the  exclusion  of  these  may  enhance  learning, 
by  field  Independent  learners.    The  characteristics  have  led 
to  the  foL^.lowing  research  question: 

o  What  effect  will  varying  the  inclusion  and  exclusion 
of  a  talking  face  to  a  text  display  have  on  learning 
by  field  dependent  and  field  independent  learners. 

Alternate  video  and  audio  forms  and  modality  strengths. 
Features  of  the  systems  which  have  been  described  in  previous 
sections  are  also  drawn  upon  in  this  section,  but 
interrelated  differently.    The  fact  that  we  can  store  and 
manipulate  large  amounts  of  visual,  auditory  and  textual  data 
with  relatively  short  computer  processing  time,  enables  the 
designers  to  store  alternative  modality  presentation  of  the 
same  material.    The  way  this  material  is  actually  manipulated 
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for  instructional  display  challenges  designers ,  and  is 
therefore  an  important  area  for  research.  Research  has  shown 
that  individuals  do  not  necessarily  select  the  modality  which 
matches  their  learning  strengths,  however,  it  has  been 
inconclusive  as  far  as  system  driven  matched  modality  is 
concerned.    Also  of  importance  in  the  selection  of  modality, 
is  whether  matched  modality  is  really  better  for  learning 
since  attention  may  suffer  from  viewing  "easy"  material.  The 
need  for  more  exploration  of  these  issues  led  to  the 
following  research  questions: 

o  What  effect  does  matching  modality  displays  with 
modality  strengths  of  learners  have  on  learning? 

o  What  effect  does  mismatching  modality  displays  with 
modality  strengths  of  learners  have  on  learning? 

o  What  effect  does  providing  alternative  modality 
presentation  for  those  learners  who  are  having 
difficulty  have  on  learning? 

Learner  Control.    A  discussion  of  research  with  the  CBLS 
would  not  be  complete  without  recognizing  the  extreme 
importance  of  research  on  the  interaction  of  learner  control 
and  all  of  the  above  variables.    While  this  question  is 
extremely  important,  it  is  the  focus  of  many  current  studies 
of  other  researchers,  and  as  such,  will  not  be  directly 
addressed  in  this  list  of  questions.    The  results  of  those 
research  studies  will  be  carefully  analyzed  for  applicability 
to  these  questions  and  where  appropriate  will  be  folded  into 
the  framework. 

While  we  also  realize  that  there  are  many  more  questions 
which  could  be  addressed,  ws  feel  that  we  have  selected  some 
important  "first  issues." 

Use  of  a  Generic  Research  Disc 

To  conduct  this  research,  we  are  proposing  to  follow  the 
strategy  Dwyer  (1978)  used  to  develop  a  series  of  guidelines 
for  using  realism  in  visual  displays.     Like  Dwyer  who 
developed  nine  general  instructional  treatments  which  varied 
level  of  realism  from  no  visual  to  black  and  white  line 
drawings  to  full  color  photographs  of  the  heart,  we  will  use 
a  series  of  visual  and  auditory  stimulus  material  which  will 
be  pressed  onto  a  videodisc.  The  treatments  for  the  various 
studies  can,  then,  be  altered  through  the  sequencing, 
selecting  of  stimulus  material  (logic  of  the  programming)  and 
the  addition  or  reorganization  of  text.    By  using  this  common 
set  of  visual  materials,  research  results  can  be  more 
legitimately  synthesized. 
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In  Dwyer's  model ,  he  selected  a  topic  which  would  not  be 
generally  known  to  the  population,  as  well  as  one  which  could 
be  varied  along  the  lines  of  levels  of  objectives.  Following 
this  lead,  and  also  for  very  practical  reasons,  we  have 
selected  nutrition  as  the  content  area.    Nutrition  topics  are 
of  general  interest,  can  be  varied  for  level  of  objective, 
and  for  the  most  part,  do  not  require  too  technical  of 
prerequisite  knowledge  which  would  eliminate  a  major  portion 
of  the  population.    A  large  database  of  visual  and  auditory 
material  currently  exists.     From  this  source,  sequences 
appropriate  to  the  research  agenda  will  be  selected  for 
inclusion  on  the  disc  once  specific  outcomes  have  been 
specified.    Their  selection  will  be  driven  by  the  detailing 
of  the  research  objectives  listed  above. 

Maximum  flexibility  will  also  direct  the  selection  of 
the  final  material  to  be  pressed  onto  the  generic  research 
disc  since  the  current  agenda  represents  only  a  beginning  of 
an  evolving  list  of  legitimate  researchable  questions 
possible  with  the  computer  based  learning  system. 

Conclusion 

The  computer  based  learning  system  which  currently  can 
be  described  as  combining  interactive  video  and  computer 
technologies  offers  new  ways  of  displaying  information  to  the 
learner.     These  new  visual  configurations  enable  researchers 
to    examine  how  these  perceptual  displays  can  be  matched 
effectively  to  the  learner's  information  processing  styles. 
Matching  content  and  context,  cognitive  perceptual  styles, 
and  modality  strengths  have  been  highlighted  out  the  myriad 
of  potential  question  possible  with  this  powerful  medium  and 
mark  the  beginning  of  continued  exploration  in  this  area. 
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AppllcatiGn  of  Heuristic  Methods 
in  the  Design  of  inteUigent  GAZ 

Intelligent  ocn{)Utei>as8isted  instnxticnal  (ICAI)  systeos  are 
diaracterized  as  holistic  instructicnal  inference-unking  systens  that  sore 
iterative  in  nature  such  that  vith  eo^erienoe,  the^  can  continxusly  iaprove 
the  learning  of  each  individual  learner  CSencpfaan  k  Iterk,  1987) .  itais 
inf erenos-naking  pxocess  is  done  by  an  intelligent  eaqpert  tutor  syston  which 
actively  seeks  to  iaprove  learning  by  (a)  initially  prescribing  iistruction 
that  has  a  hlg(h  pcobalbility  of  pcevcnting  learner  error  an^or  aisconoepticns, 
(b)  that  oontinuusly  adapts  the  pcescribed  instructicn  aooording  to  nanent- 
to-sanent  wiieenment  and  diagnosis,  and  (c)  ^Mwratively  isprovis  its  decision- 
making  systm.  Figurs  1  illustrates  the  various  instructionBl  variables  that 
thm  lAZS  eMpert  tutor  nanagwant  systaa  adapts  to  individual  learner 
differanoes  and  needs  during  instruction  (TvsvKn  &  ChristenMn,  1988) .  ihese 
variables,  termed  ocnputerHdased  enhanoanents,  are  managed  by  the  ei^ek  tutor 
«n{>loying  both  formal  and  informal  artificially  intelligent  (AI)  heuristic 
pcogranning  methods  (Domer,  1983;  Tikhcmirovr,  1983) . 


Insert  Figure  1  about  here 


13m  intelligent  learning  syster  presented  in  this  paper,  the  MAIS,  is 
based  en  the  findings  of  an  extens:     programnatic  research  effort 
investigating  the  direct  oonnectiGns  among  such  learning  environent  factors 
as  individual  differences,  cognitive  learning  theory,  instructional  technology, 
subject  matter  structure,  and  delivery  systans  (ee^iecially  ooniuter'-assisted 
instruction) .  neon  the  interaction  of  these  factors,  a  MAlS-based  IGAI 
pKogram  can  be  developed  with  reasoraible  success  in  reference  to  oost- 
ef  f ectiveness  principles  of  iqproved  learning  %dthin  standard  production 
costs.  Ofaat  is,  unlike  conventional  IGAI  denonetration  (or  protot?^) 
programs  that  require  costly  dapendenoe  on  powerful  hardware  and  software 
systems  (e.g.,  a  LISP  machine) ,  a  MAIS-based  ICAI  program  can  be  developed 
vdthin  current  microocofuter  constraints  of  ?«latively  limited  memory. 

Heuristic  Procrraimdng 

The  purpose  of  this  paper  is  to  present  the  BASIC  progranning  code  for 
the  heuristic  cnployed  in  the  MAIS.  K<e  have  tried  to  make  the  following  code 
as  generic  as  possible  so  that  anyone  with  at  least  a  working  loxjwledge  of 
BASIC  or  some  other  language  could  easily  design  and  program  an  ICAI. 
Remenfcer  that  each  of  the  variables  of  eo^tert  tutor  is  independent  of  the 
others,  thus  the  selection  of  the  individual  variables  is  up  to  the  designer. 
Ihe  only  major  d^«ndent  function  needed  to  operate  the  MAIS  expert  tutor  is 
the  Be^ian  conditional  probability  statistic.  Ihe  Bayesian  function  sets 
the  parameters  of  the  mastery  learning  quality  control  of  the  MAIS.  That  is, 
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Figure  1.  Illustration  of  Instructional  variables  monitored  by  the  MAIS  expert  tutor. 
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the  Bayeslan  provides  the  infomatian  on  the  decision  of  whether  to  advance  or 
retain  the  learner. 

The  statistical  parameters  in  the  Bayesian  method  allow  the  designer  to 
determine  the  difficulty  of  the  sastery  learning  decision,   m  our  research  we 
hetve  estetblished  a  standard  format  for  the  threa  parameters  of  -Uie  Bayesian 
statistic.  Within  tills  pe^jer  we  will  pr^ent  only  this  standard  focnat 
because  it  lases  a  heuristic  that  is  very  slxple  to  program  for  use  on  a 
alcroocntxtter,  Astvanced  users  may  want  to  deal  directly  witii  the  fomula  that 
calailates  Individual  beta  value  tables.   This  Infoonatlon  is  in  !tennyson, 
Christensen,  and  S.  Bark  (1984) . 

The  ocqputerHsased  variables  c£  the  esqpert  tutor  are  presented  below  as 
subroutines.   Ocpies  of  an  operating  disk  with  sanple  lesson  are  available  by 
writing  directly  to  the  authors. 

Beta  Value  Oanautatlon 

■The^Bi^lan  subroutine  returns  a  two  digit  beta  value  for  calculations 
that  are  needed  in  ocnputlng  amount  of  Information,  advisement,  and  display 
time  Interval  (Tennyson  et  al. ,  1984) .   The  calculations  in  this  standardized 
subroutine  are  an  approodmatlon  of  the  lnooni>lete  beta  function.   The  valttes 
from  the  Inoonplete  beta  function  with  a  loss  ratio  of  .3  (this  figure  is  a 
statistical  valvte  in  the  Bayesian  fomula  and  ranges  between  values  of  .275  and 
.325,  with  the  hicfher  values  resulting  In  Increasingly  conservative  control 
over  a  false  advmce  versus  a  fEdse  retain) ,  a  mastery  critsrion  level  of  .75 
(recall  that  this  figure  must  include  learning  error,  tihous  it  may  seesa  lower 
than  xisual  levels  for  post  test  xaastery  learning  objectives) ,  and  the  nuaiaer  of 
interrogatory  exanples  at  14  (this  nunber  oould  be  increased,  but  should  not 
really  be  decreased  to  maintain  power  of  the  statistic)  is  sent  to  a  non- 
linear regression  program  that  fits  the  best  polynomial.  The  reason  for  the 
polynondal  fit  is  to  eliminate  the  need  for  calculating  the  beta  value 
continuously  throughout  the  pxagram  (this  is  certainly  possible  however  on 
larger  mini-  and  main-frame  ocnputers) . 

INTOT       The  only  input  required  is  the  number  of  examples  correct  and 

the  number  of  exasples  pr^ented. 
(XTTEUr     TWO  place  beta  value. 

Variable  List  and  e>^lanatdon; 

OORRECT  Number  of  exasples  that  were  correct. 

CRESENT  Nunber  of  exanples  that  were  presented.    (Note:   The  code 

  ERESEMr^2,  means  to  the  second  power.) 

EEIA  Beta  value. 

CO,  CI,  C2  Variables  used  in  polyncndal 

Code: 

100  CO  =  -.385747  +  .0507146  *  iraSEMT  -  .00328486  *  HRESEN'r^2  + 
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.0000935574  *  HSSENT^S 
200  CL  +  1.37385  -  .2958510  *  KZBSEHT  *  .02450580  *  ISESE1II^2  - 

.0007305730  *  ISESE1IF^3 
300  C2  +  -.273399  +  .0767955  *  IRESENr  -  .00725163  *  H?ESQII^2  + 

.00023077470  *  ISESQn^3 
400  BEIA  +  CO  +  CI  *  CUKHldUi'  4C2  *  G0BBEC!r^2 
500  BEHA  +  INT  CABS(BEaA  *  100  +  .5)]  /  100 

tfasterv  gheric  rmA  a<»rjBqiw=^ 

This  suibrcutins  uses  the  ccnputed  beta  valiie  to  determine  \ft)ether  a  given 
learner  has  nastered  a  given  cancxpt  or  rule  (Tennyscn  &  Buttrey,  1984) .  Bie 
mastery  decisicn  is  used  by  the  covert  tutor  to  nalce  a  decision  on  when  to 
terminate  instruction.   For  leeax)et  control  situations,  the  es^ert  tutor 
advises  the  learner  of  his/her  progress  and  reocnutenas  an  appropriate  decision, 
but  allows  tbB  learner  to  decide  «hen  to  terminate  (Johaisen  &  Otennyson, 
1984).   This  subroutine  r^nrts  to  the  learner,  after  each  exancae,  his/her 
current  level  of  mastery  regardless  of  learner  control  or  program  control. 
Note  that  multiple  ccno^tts  and  rules  (ooordihate)  .can  also  be  used  in  this 
subroutine,   m  the  follcwing  exanple  code,  tiie  lesson  has  fc»r  concepts. 

IMHTT       Beta  valvte 

Nlaiser  of  exanples  presented  for  each  oonexpt. 
CGIEUT     Booleen  statement— mastered  or  not  mastered  conaept(s) .  BEIA 

value  HONIED  to  advise  learner  of  progress. 

Variable  list  and  e}^lanation: 

BEIA(       Beta  valiaes  from  subroutine  in  array  format 

Mtojnaaaj(  Array  to  determine  concept  mastered  (1)  or  not  (0) 

H^ESpn?(  Array  for  nusber  of  eseanples  presented  in  each  oono^ 

OCNGEHT    Nuniber  of  concept 

MAST        isocumulate  mastery  o£  all  concepts 

EX  Aocunulate  esdiausted  pool  for  ounoepts 

Code: 

XXIO  BEK  Reset  EX  and  lAST  to  0 
XX20  EX  «  0:    MAST  -  0 
XX30  REM  Mastery  check 
*  XX40  FCR  OGNCEFT  «  1  TO  4 

XX50  IF  BE!I!A(1)  >  75  THEN  MASTERED(I)  =  1:    DCNE  =  MftST  =  MAST  +  1 
XX60  IF  IRESEOT(OpNCF.:T)  >  13  THEN  EXHAUST  =  EX  «  EX  +  1 
XX70  NEXT  OQNCEET 

XX80  REM  Determine  if  all  concepts  mastered  or  example  pools  esdiausted 
XX90  IF  EX  +  MRST  ■  4  THEN  (EXIT  TO  END  OF  HWSOM) 
XlOO  REM  Print  advisement 
XliO  FCR  OONCEPT  «  1  TO  4 

X120  REM  Format  screen  for  your  desired  presentation 
X130  ERINT  BETA(OCNCEPr) 
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X140  NDCr  OCNCEPT 
X150  BEIUFN 

T^mlm  Time  mterval 

Ihis  subroutine  nonitors  and  updates  tite  learning  tine  of  tiie 
interrogatory  (ptractioe)  exanctles  ity  incsDeasing  the  amount  of  tine  for  corxect 
solutions  (Tennyson  &  Park,  1984,  1985) .  Ihis  mis  ertianoonent  nonitors 
learning  tine  for  two  purpose:    (a)  to  provide  imnediate  instructional  help 
if  the  learner  has  not  yet  developed  sufficient  pcooedural  kncfvledge;  and  (b) 
to  prevent  the  learner  fron  being  farced  into  naldng  an  inoorrect  response 
(Tennyson,  Baric,  &  Cfaristensen,  1985)  .  Monitoring  tiie  learning  tine  is  not  a 
only  a  means  to  iaprove  effec±iveness  of  the  iistruction,  but  also  to  laintain 
efficiency  of       learning  environment.  That  is,  time  available  for  leaniing 
is  a  finite  variable  controlled  by  both  external  factors  (e.g.,  school  tine  . 
periods,  time  of  the  day,  excess  to  aipropriate  facilities,  etc.)  and  internal 
factors  (e.g.,  fatigue,  attention,  effort,  etc.). 

Because  the  parameters  of  this  suOarcutine  include  statistical  values 
concerning  (a)  difficulty  of  the  oono^,  (b)  difficulty  of  each  exan{)le,  and 
(c)  update  in  naming  progress,  it  is  necessary  to  establii^  tliese  values 
before  using  the  learning  time  subroutine.  :di  practice,  we  initially  estimate 
these  values  and  then  collect  actual  tines  to  precisely  set  the  values.  (A 
detailed  discussion  of  these  parameters  is  given  in  Tennyson,  O.  Bark,  & 
Christensen,  1984). 

INHJr       Beta  Value 

Exasple  to  presented  next 

Exasple  Difficulty  Index  (EDI)    (mean  time  for 

esqperts  to  answer  problem  correctly) 
Oonc^  Standard  (statistical  mean  time  of  EDIs) 
Concept  Difficulty  Iivaex  (CDI)  (statistical 

varianoe  of  EDIs) 
Tnrfipf>  tine  on  exanple 
CXJTHJT     Learning  tine 

Concept  Difficulty  Index  (value  added  to  increase 

learning  tine) 

Variable  List  and  es^lanation: 

LAPSE  Total  elapsed  tine 

lOCAL  Local  current  exasple's  learning  tine 

CPI(  Array  for  cono^  difficulty  index 

BEIk  Beta  value 

EDI(  Array  for  concept  difficulty  index 

RESPCMSE  Last  response  0  »  inoorrcct;  1  «  Correct;  2  »  Tine  elapsed 

CCNCEFT  Current  concept  being  presented 

STANDARD(  Array  of  cono^  standard 

EXAMPLE:(  Hob  specific  exanple  to  be  presented  next 
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XXIO  BEM  Chedc  learning  time  agednst  elz^ieed  ^-^^ 

XX20  IF  lASSE  >  lOCAL  THEN  BESFCMSE  «  2 

XX30  BEH  Oonoqat  difficulty  index  subroutine 

XX40  GCa:(OCNCEPr)  «  COSHCOKEPI)  +  EESA  *  STANI»RD(0CKCSPT) 

XX50  BEM  learning  time  subroutine 

XX60  lOCKL  «  mE(EXM<E[£)  +  CDI(GCNCEET) 

fbr  exanple,  if  the  total  set  of  exaaixLes  for  a  given  concs^  has  a  mean 
value  of  17  sec.  (STAMDABD) ,  and  a  variance  of  2.5  sec.  (GDI) ,  ani  a  current 
beta  valxie  of  .55,  the  calculation  for  the  concept  difficulty  index  would  be 
ttsB  folloHing: 

CDI(OonC3ept)  «  2.5  +  .55  *  17 
CDl(OQnoept)  «  11.85 

For  the  next  exanple  (if  current  example  correctly  answered  and  an  EDI  va3ue 
of  15  sec.) ,  the  learning  time  value  wsuld  be  increased  as  follows: 

UXKL  »  15  +  11.85 
IIXAL  «  26.85 

This  heuristic  allows  for  an  iterative  learning  ^^two  incxeeise  with  each 
succeeding  correct  respcnse. 

Farmal  of  ExaHPles  ana  Seauencae 

This  subroutine  selects  the  f oooat  of  the  next  exanple  according  to  the 
resprjnse  given  to  tbB  current  exanple,  as  fbllows:   if  correct  or  if  time 
elapses,  the  next  exanple  will  be  in  an  interrogatory  fonat;  if  inocrrect,  it 
will  be  ponesented  as  an  esqxjsitory  exanple  (Park  &  Tennyson,  1986) .  Also, 
this  subroutine  selects  the  seguenoe  of  the  next  exanple  according  to,  first, 
the  generalization  rule  (usually  for  the  first  four  interrogatory  exanples) 
and,  second,  the  discrimination  rule  (usually  starting  with  the  fifth  exsmple 
(Park  &  Tennyson,  1S80) .  Ihis  subroutine  also  determines  that  xx>  exanple  is 
presented  more  than  once  and  that  no  exanple  is  presented  if  the  exanple  pool 
is  esdiausted. 

INHJT       Last  response 

Ooinoept  presented  and  selected 

NUooDber  of  exanples  for  each  cono^  presented 

OTlHJr     Seguaioe  of  next  oono^  and  format  of  exanple 

Variable  list  and  es^lanation: 

FiSPONSE  Last  response,  0  »  ]iv»rrect;  1  =  Correct;  2  «  Time  elapsed 

iiNSWER  Last  concept  selected 

EXAMEOE  Nunber  of  exanple  selected 

SEQCJSNCE  0  «  Generalization;  1  »  Discrimination 
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MftS'mMJ(  Array  to  ietemine  oono^  mastered  (l)  or  not  (0) 
Msnarsj  Array  for  nmber  of  exanples  pfresented  in  each  oaisept 
OGNCEET    MUniser  of  conoqit 

XXIO  HEM  Select  exanple  nuniaer  frcn  pool 
XX20  EXAMEIE  «  INr(BND(l)  *  ?A  +  1 

XX30  BBf  First  fcur  exanftles  preseixted  in  each  ccnoept  are  generalization 

XX40  IF  SEQOENCE  «  LAND  ISES2NT(CSNCEFr)  <  5  THEN  SBOOEMCE  >  0 

XX50  IF  SBCPENCE  «  1  AND  ISESENT(CX»CEET)  >  4  THEM  SBgOEMCE  •  1 

XX60  REM  Mien  response  is  incorrect  or  time,  elapsed  and  generalization  is  in 

effect  then  oondept  to  be  selected  reoains  tb&  same 
XX70  IF  RESKKSE  «  0  OR  (RBSFCNSE  «  2  AND  SEgOElVCE  «  0)  ISEtf  GQflO  X120 
XX80  REM  If  response  is  inexauect  and  disorindnation  then  nex^  concept  to  be 

sheeted  is  the  learner's  incorrect  response 
XX90  IF  RESFCNSE  «  0  TBEXt  OGNCEET  «  ANSWER:    GCXEO  X120 

xloo  ancEET  « imtatDii)  *  4  +  i) 

mo  RQI  Dstemine  exanple  pool  eodiausted  /  If  eidiausted  then  re^xxise  must  be 

changed  to  ootatict  so  randcm  select  of  oono^  occurs 
X120  IF  IRESEMr(OCNCSET)  >  13  OBEM  RBSFCNSE  «  1:    GOZO  mo 
X130  REM  If  response  is  oatt:recL  and  oono^  not  mastered  then  start  over 
XX40  IF  RBSFCNSE  >  1  AND  MaS!IXRED(O0NCEFr)  >  0  IHEN  GQflD  mO 
X150  REM  If  exaaple  was  xised  Isef ore  start  over 
X160  IF  SEIECilEDCOCNCEgr^EXaMPIE)  >  1  THEN  GCHO  XXIO 

X170  SEmciED(ocNasgr^ExaMEm)  *  i 

X180  REIORN 

Ihe  variables  of  corrective  error  analysis  and  eoftscxaded  refreshment  and 
remediation  are  taslc-fipecific  enhancements  that  are  designed  at  the  point  of 
individual  lesson  developownt.  Ihe  iaportant  concept  for  the  former  variable 
is  to  consider  the  type  or  analysis  as  a  function  of  the  instructional 
strategy  to  be  eaployed.   For  the  latter  variable,  the  design  decision  ocmes 
from  the  structure  of  the  content  to  be  learned.   Both  of  these  variables  need 
attention  so  as  to  provide  astequate  instructional  help,  but  not  to  the  point 
of  reducing  efficiency  of  the  learner.   For  exanple,  too  mcich  interference 
frcm  adjunct  instruction  can  distaract  the  learner  and  consequently  use  vp 
valuable  learning  time. 

Sunmary 

Our  furpcse  in  this  pe^ser  was  to  present  the  program  code  of  the 
heuristics  enployed  in  the  MAISc  Tha  »AIS  program  is  supported  by  both 
learning  theory  and  instructional  tteoiy.  Also,  the  insteuctiaial  variables 
and  conditions  of  the  NAIS  are  supported  by  enpirical  verification;  tested  in 
a  well-defined  program  of  research,  and  evaluated  by  disciplined  peer  review. 
Ihe  value  of  the  theory-bsBed  instructional  design  system  suipacted  by  direct 
research  findings  is  that  it  can  be  generalized  to  specific  learning  needs  and 
conditions.  And,  for  isplementation  purposes,  the  MAIS  is  readily  transferable 
to  most  currently  available  hardware  and  software.  And,  as  oonputer  technology 
itself  inprcrves,  it  will  be  possible  to  both  ehhanoe  the  present  variables  and 
conditions  yet  to  be  discovered.   Seme  of  these  new  variable  will  come  from 
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research  in  such  diverse  ea:eas  as  individual  differences,  faunan-nachine 
interface  design,  neuropsychology,  peychcnetxics,  cxxputer  software, 
peroei±ion,  and  the  oontinuing  signif  icanb  research  and  tiieocy  developooent  in 
tb&  field  of  instructional  technology,  curricular  management  as  well  as 
hardware  a^id  software  develcpnents. 
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Professional  Ethics:    An  Analysis  of  Some  Argunients 
for  Development  of  virtuous  Behavior 

by 

Thomas  M«  Schwen 


After  a  long  period  of  relative  inactivity,  we 
have  seen  a  resurgence  in  interest  in  the  topic  of 
professional  ethics  in  ours  and  related  fields.  Recent 
activation  of  our  Professional  Ethics  Committee, 
convention  sessions  like  the  one  today^  articles  in 
professional  and  scholarly  journals,  all  signal  a  level 
of  interest  that  has  not  been  present  for  several 
years.     It  is  hot  an  original  thought  that  the 
wide-spread  reporting  of  misconduct  on  the  part  of 
business  leaders,  financial  traders  and  professionals 
of  all  sorts,  is  a  significant  cause  of  this  resurgence 
of  interest.    The  general  hypothesis  seems  to  be  these 
pxiblic  failures  are  a  symptom  of  a  general  shift  in  the 
moral  values  that  guide  behavior  between  and  among 
professionals  and  clients  in  our  society. 

A  major  assumption  of  this  paper  is  that  much  of 
the  pxiblic  discussion  is  irrelevant  to  our  concerns  as 
professionals.    The  "micro"  moral  decision  ma-zing 
processes  that  constitute  the  day  to  day  fabric  of 
ethical  behavior  hold  much  more  philosophic  and 
psychological  interest  to  practicing  professionals. 
The  personal  failures  that  are  publicly  reported  are 
qualitatively  different  and  although  that  may  be  the 
result  of  an  aggregate  of  ethical  decisions  across 
time,  they  are  not  very  interesting  in  either  a 
philosophical  or  psychological  sense.    They  provide 
little  useful  content  for  a  philosophic  or 
psychological  amalysis  of  the  conditions  that  promote 
virtuous  behavior. 

The  major  premise  of  this  paper  is  that  visrtuous 
behavior,   (Frankena  1976)  trait-like  behavior  that 
meets  or  exceeds  the  commonly  held  values  of  the 
profession,  can  be  fostered  by  associations'  of 
professionals.    This  virtuous  behavior  must  be  well 
understood  and  modeled  if  this  influence  is  to  benefit 
the  profession. 
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Before  more  specific  issues  can  be  discussed,  a 
n\2iQber  of  definitions  must  be  considered.  First 
principles  or  moral  rules  (Frankena  1976)  are  orten 
suggested  or  iiiqplied  in  professional  codes  of  ethics. 
In  the  AECT  Code  of  Ethics,   (Human  Resources  Directory, 
Page  6)  several  commonly  held  moral  roles  may  be 
tacitly  seen  in  the  twenty  two  secondary  principles 
stated  in  the  code.    The  rule  **do  no  harm",  may  be 
inferred  in  Section  I,  item  4,  **Shall  conduct  business 
so  as  to  protect  the  privacy  and  maintain  the  personal 
integrity  of  the  individual.**  The  rule  "treat  all 
equally"  may  be  inferred  in  Section  II,  Item  5,  "Shall 
engage  in  fair  and  equitable  practices  with  those 
rendering  service  to  the  profession."  These  general 
3n2les  or  first  principles  are  not  easily  derived  in  a 
philosophic  sense.    Some  philosophers  argue  that  these 
principles  are  a  part  of  our  basic  nature,   (  Ross. 
W.D.)  some  others  argue  that  they  can  be  en^irically 
derived^     (Rashdall,  H.)  In  any  event,  these  first 
principles  often  form  the  core  of  beliefs  of  religious 
groups,  socxeties,  or  professional  groups.    It  is 
curious  that  these  principals  are  rarely  made  explicit. 
They  seem  to  be  assumed  as  a  part  of  the  implicit  norms 
of  the  group  of  individuals  who  hold  these  views, 
especially  in  professional  societies. 

These  moral  amies  are  most  often  used  in  the 
mamner  of  Socrates  when  in  engaged  in  moral  reasoning. 
(Frankena  1973)  If,  for  example,  an  educational 
technologist  has  completed  an  analysis  of  different 
conqputers  to  deliver  instruction  for  his/her 
institution  and  two  or  more  vendors  could  successfully 
conqpete  to  fulfill  the  technical  requirements  of  the 
analysis,  the  first  principle, "treat  all  equally"  and 
"do  no  harm"  could  be  shown  to  be  applicable  to  the 
situation  in  which  two  or  more  vendors  were  competing 
for  the  right  to  sell  the  computers ^    Further,  if  one 
of  the  vendorjtf  offered  a  personal  gratuity  to  the 
educational  technologist,  the  technologist  could 
reason:  *  "If  I  accept  the  gratuity,  I  will  not  be 
treating  the  vendors  equally,  and,  "If  I  accept  the 
gratuity,  I  will  be  harming  the  reputation  of  my 
institution  and  my  profession."  Both  of  these  logical 
moves  bring  the  principle  together  with  the  facts 
relevant  to  the  decision  to  be  made.    Then  the 
educational  technologist  would  come  to  the  conclusion 
that  he/she  could  not  accept  the  gitatuity  even  if  the 
bid  for  the  conqputers  was  the  lowest  competitive  bid. 
This  rather  abbreviated  and  straight  for  trard  example  has 
the  advantage  of  illustrating  tihe  three  pasrt  process  of 
moral  reasoning:     1)  statement  of  first  principles r  2) 
combining  first  principles  with  relevant  facts,  and  3) 
drawing  a  conclusion  in  a  rational  and  dispassionate 
manner  with  some  understanding  of  the  consequences  of 
the  alternatives.    In  more  complex  situations,  the 
application  of  principles  may  not  lead  to  the  same 
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conclusion.    Then  it  is  usually  necessary  to  decide 
which  principle  takes  precedence.    The  dialogue  in  the 
process  of  discussing  a  specific  moral  decision  could 
well  involve  the  challenge  of  the  principles,  the 
decisions  of  which  rule  is  more  basic  or  ftuidamental  or 
the  logic  by  which  conclusions  were  derived  from  f^ccs 
and  principles. 

I  have  *!ised  the  term  moral  several  times  in  this 
discussion.    From  the  philosophic  perspective,  ethics 
is  a  branch  of  moral  philosophy.     (Brody)  (Vallance) 
Moral  reasoning  defined  above  Is  an  analytic 
philosophic  process  having  tc  do  t/ith  moral  decisions 
of  right  and  wrong,  duty  or  oblicration  wherein  the 
alternatives  affect  individuals  or  groups  of 
individuals.    In  our  profession,  we  have  a  deep  and 
abiding  internet  in  at  least  two  types  of  moral 
knowledge.    1)  We  are  often  interested  in  a 
psychological  or  anthropological  sense  in  the  values  or 
noanos  of  our  client  systems  or  our  own  culture  as  in 
Paul  Welliver^s  paper  delivered  today.    We  pursue 
scientific  knowledge  about  moral  meaning  that  affects 
the  conduct  of  our  professional  duties.    Some  times  we 
pursue  knowledge  to  influence  the  client  system  in 
educational  or  training  interventions  and  at  other 
times,  to  model  in  a  scientific  sense,  moral  meaning 
and  behavior  in  our  profession.    2)  As  judging  by  our 
collective  scholarly  behavior,  we  have  an  interest  but 
perhaps  less  abiding  in  the  philosophic  questions  of 
what  is  good  or  what  duties  or  obligations  coincide 
with  our  professional  status.    In  section  I  of  our 
ethical  code,   (Ktunan  Resources  Directory,  P.     6)  our 
colleagues  who  wrote  the  document  take  it  as  inherently 
good  that  we  "^promote  correct  and  sound  professional 
practices  in  the  use  of  technology  in  education**  or 
that  it  would  be  wrong  in  Section  II  to  **use 
institutional  or  associational  privileges  for  private 
gain.**  These  are  philosophic  normative  assertions  of 
right  and  wrong.    We  have,  presumably  in  a  scholarly 
manner,  engaged  in  philosophic  reasoning  that  lead  to 
these  assertions.    This  important  form  of  inquiry  is 
nearly  non-existent  in  our  profession. 

There  is  a  third  kind  of  philosophic  moral  inquiry 
that  deals  with  meta  issues  that  are  more  often  than 
not  left  to  philosophers.    Thry  include  such  issues  as: 
What  is  the  meaning  of  good  or  bad  in  an  expression  of 
moral  reasoning?**  Or  perhaps  more  relevant  to  our 
discussion  today,  how  do  we  distinguish  between  moral 
and  non*moral  decisions?    At  any  rate,  the  philosophic 
inquiry  of  this  type  is  usually  outside  the  realm  of 
our  professional  discourse.    It  is  however,  quite 
relevant  to  our  gaining  sufficient  prowess  in  ethical 
decision  making  ov^r  time. 
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The  common  use  of  the  terms  ethical  or  moral  are 
usually  associated  with  good  and  tne  opposites 
\methical  or  immoral  are  of  course  associated  with  bad 
or  wrong  motives  and  subsequent  behavior*  (Frankena 
1973)  Philosophers  use  quite  different  distinctions 
that  are  inqportant  to  our  discussion*    Moral  is  a  term 
that  is  defined  as  coordinate  with  history/  science  or 
other  disciplines*    The  opposing  terms  would  be 
non-*moral  or  non--ethical  •    So  in  an  expanded  process  of 
moral  reasoning/  the  first  step  would  be  to  distinguish 
betwe>)en  decisions  that  are  moral  or  pertain  to  morality 
or  ethics  and  those  that  are  technical  or  non-moral* 
For  example/  I  once  invested  a  great  deal  of  - 
intellectual  energy  dialoging  with  myself  about  the 
**ethical**  decision  of  portraying  a  faculty  member  as 
excellent  or  adequate  in  a  problematic  tenure  case. 
After  considerable  time  and  energy  was  invested/  I 
decided  that  the  decision  wasn't  ethical  at  all  it  was 
non-*moral  (**non-*ethical**)  •    I  was  being  asked  to 
excercisn  a  technical  judgment  based  on  the  science  of 
my  profession.    The  tenure  rules  were  well  understood 
and  accepted  by  all  parties.    All  parties  had  acted  in 
a  manner  consistent  with  moral  rules  I  knew*  The 
decision  could  have  been  ethical  or  moral  if  issues  of 
duty/  obligation/  rightness  or  wrongness  of  the  process 
or  individual  behavior  associated  with  my  decision  to 
characterise  the  faculty  member  as  adeqpiate  or 
excellent  had  been  involved.    In  this  case/  I  reasoned 
that  there  was  sufficient  evidence  to  come  to  a 
technical  judgment  based  on  the  evidence  at  hand.  My 
concern  for  the  faculty  member  was  an  emotional  concern 
not  primarily  related  to  first  principles  of  right  or 
wrong/  duty  or  obligation. 

Virtue  is  a  term  not  often  used  in  professional 
prose.    Virtue  in  this  context  means  the  dispositici  to 
behave  in  a  manner  consistent  with  moral  values  or 
moral  principles.    As  noted  above/  the  most  important 
premise  of  this  paper  is  that  we  have  a  professional 
obligation  to  create  conditions  which  illicit  and 
promote  virtuous  conduct.    To  focus  exclusively  on 
moral  reasoning  or  cor    rmi ty  to  rules  is  inconsistent 
with  our  professionali.  Knowledge.    As  an  applied 
psychological  profession/  we  certainly  believe  that 
conqplex  rule  like  behavior  is  not  tenable  without 
addressing  the  motivation  or  higher  order  meaninc^  that 
promotes  that  behavior.    Certainly  the  piablishing  of  a 
code  of  ethics  with  no  provision  for  explanation/ 
application  or  interpretation  in  a  training  context 
would  be  xaniformly  considered  inadequate  behavior  on 
the  part  of  qualified  instructional  designers.  One 
wonders  why  we  find  it  acceptable  to  provide  this 
limited  training  support  for  practicing  professionals 
in  our  profession. 
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Ifhat  would  constitute  adequate  conditions  for 
fostering  virtuous  professional  behavior  in  our 
associations?    Ne  certainly  should  more  actively  pursue 
the  first  two  kinds  of  moral  knowledge  discussed  above* 
The  study  of  ouk'  professional  conduct  is  certainly  a 
proper  and  worthwhile  scholarly  goal*    Ne  should  invest 
considerable  energy  in  describing  moral  meaning  and 
behavior  in  our  profession*    We  would  certainly  be  well 
advised  to  model  and  predict  this  behavior  as  well* 
Our  scholarly  journals  should  solicit  such  inquiry  if 
it  is  not  readily  forthcoming*    Also,  we  should  use 
this  knowledge  to  change  our  training  programs  and  to 
modify  the  conduct  of  our  professionals  in  our  society* 

In  addition,  we  should  encourage  our  own  scholars 
or  solicit  philosophers  to  engage  in  philosophic 
inquiry  that  allowed  us  to  be  more  clear  about  the 
meaning  of  our  moral  values*    Ne  should  define  the 
first  order  and  secondary  principles  that  are  relevant 
to  our  profession*    Ne  should  attempt  to  prioritize  our 
values  and  examine  those  priorities  in  difficult  cases* 
(Vallance) 

We  should  explore  moral  reasoning  in  our 
literature  and  in  our  training  programs*    The  process 
of  moral  reasoning  is  largely  untaught  in  our 
professional  programs  and  it  is  unexamined  in  our 
professional  literature*    The  process  requires 
sophisticated  knowledge  and  reasoning  processes*  We 
certainly  treat  far  less  important  professional  goals 
more  seriously  than  we  regard  this  vital  skill* 

Ne  should  re-examine  our  professional  code  of 
ethics  and  clarify  the  scholarly  assun^tions  and 
analysis  that  went  into  the  design  of  the  code*  Our 
code  is  a  fairly  traditional  statement  of  second  order 
or  applied  principles  of  duty  and  obligation*    At  a 
minimtim,  our  more  primary  principles  should  be  made 
explicit  and  exanqples  or  case  vignettes  should  be 
published  so  that  the  codo  of  ethics  can  be  applied 
with  more  precision  and  sophistication*    it  seems  ci>at 
the  authors  of  our  code  and  con^arable  codes  feel  that 
the  codes  are  self  evident  in  their  application « 
Certainly  our  status  aa  professional  educators  would 
suggest  fallacy  of  that  assunqption* 

The  dispositions  or  traits  of  virtuous 
professionals  should  be  more  carefully  described, 
analyzed  and  promulgated*    If  we  are  serious  about  oul 
concern  for  moral  decision  making  in  our  profession, 
the  best  models  of  this  disposition  must  be  made 
explicit  and  held  up  as  worthy  of  emulation*    In  our 
pluralistic  society,  we  seem  to  believe  that  mat'^ers  of 
virtue  and  moral  behi^vior  are  not  proper  concerns  for 
professional  dialogue  outside  the  churches,  synagogues 
or  other  religious  institutions  of  worship*    It  has 
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often  been  my  experience  that  words  such  as  virtue  or 
moral  values  evoke  ridicule  or  uncomforteQ^le  silence  in 
professional  dialogue*    It  seems  to  me  that  the  very 
fact  of  our  pluralism  argues  for  a  scholarly 
professional  inquiry  and  development  in  the  ethical 
issues  of  our  profession*    Our  duty  is  to  be  clear  with 
one  amother  about  moral  decision  making  and 
particularly  the  conditions  that  promote  virtuous 
behavior*    We  seek  not  to  replace  our  religious 
institutions  we  must  exceptionally  be  clear  about  the 
moral  decision  making  in  those  arenas  where  many 
ideologies  intersect  in  our  society*    Otherwise  we 
create  an  environment  of  moral  uncertainty  or 
professional  caveat  emptor* 

In  summary,  I  should  say  that  there  are  several 
limitations  to  my  arguments  especially  my  philosophic 
arguments*    In  some  cases,  time  and  space  did  not 
pemit  more  complete  arguments »    For  example^  I  have 
taken  a  position  w'xich  philosophers  label 
deontological*     (Brody)  That  is,  I  speak  of  moral 
decision  making  as  a  process  derived  from  moral  rules 
or  first  principles*    This  position  is  held  in  contrast 
to  a  teleological  position  which  would  argue  that  first 
principles  cemnot  be  derived  and  that  non*-moral  good  or 
consequences  of  moral  decisions  would  be  the  basis  for 
making  moral  decisions*    Decisions  would  be  made  to 
achieve  the  greatest  good*     Interesting  and  useful 
arguments  about  professional  ethics  could  be  made  from 
a  teleological  position*    However,  the  conclusion  of 
this  paper  would  be  the  same*    We  have  a  duty  to  create 
greater  understanding  of  and  the  conditions  which 
promote  virtuous  beha'v  ,or*    Also,  my  philosophic 
arguments  are  the  arguments  of  a  student  rather  thatn 
the  master  of  the  discipline*    This  is  the  dilemma  of 
many  professionals  interested  in  professional  ethics* 
Gaining  competence  is  difficult  because  our  training 
was  in  other  disciplines* 

Finally,  the  last  stage  of  my  argument  was  more 
psychological  than  philosophical*    In  essence,  I  argued 
that  our  professional  knowledge  2Q:)out  teaching  complex 
understandings  and  rule  behavior  would  lead  inevitably 
to  jt  chamge  in  our  current  professional  practices  in 
areas  of  traiining  professionals,  publishing  scholarly 
works  and  association  actions*    I  believe  the  argument 
could  be  made  just  as  well  on  philosophic  grounds,  in 
brief,  if  we  are  committed  to  concepts  of  duty, 
obligation  or  right  actions  as  basic  to  our 
professional  status,  tliat  commitment  should  lead  to  a 
better  philosophic  definition  and  understauading  of  what 
we  mean  by  those  terms  and  that  understanding  in  turn 
would  lead  to  the  specific  duty  of  creating  appropriate 
conditions  to  foster  virtuous  behavior* 
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